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(54) Moving picture decoding circuit 

(57) When a macro block (MB) synchronizing signal 
(MBSYNC) indicating starting of processing is asserted 
in processing of one processing section which is formed 
by a macro block header and a macro block, block data 
of the macro block (MB) are decoded in synchronization 
with the assertion of MBSYNC, and next macro block 
header information is analyzed in continuation in the 



processing section. The assertion of the next MB syn- 
chronizing signal is stopped until prescribed conditions 
are established. Processing of the block data of the 
macro blocks is regularly executed from starting of one 
processing section, whereby utilization efficiency of 
operational processors is improved. 
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Description 

BACKGROUND OF THE INVENTION 

Field of the Invention 

The present Invention relates to a picture decoding 
circuit for expanding compressed picture data and 
restoring uncompressed picture data, and more particu- 
larly, it relates to a moving picture decoding circuit for 
expanding picture data which are compressed in 
accordance with a moving picture compression system 
employing orthogonal transformation and inter- 
frame/inter-field predictive encoding. 

Description of the Background Art 

There has been proposed a system of encoding an 
enormous quantity of pcture data in high efficiency to 
reduce the amount of data for transmission and decod- 
ing the transmitted picture data encoded in high effi- 
ciency thereby restoring the original pictures. Such 
picture data processing systems include the MPEG 
(moving picture experts group) standard, which is 
directed to moving pictures. While the system of encod- 
ing pixel data under the MPEG standard is well known in 
the art. the system of encoding picture data along the 
MPEG standard is now described, in order to facilitate 
understanding of the background of the present inven- 
tion. 

Rg. 27 schematically illustrates the structure of a 
general picture data encoding unit along the MPEG 
standard. Referring to Fig. 27, the encoding unit 
includes a sut>tracter 1000 which obtains difference 
between input pixel data and corresponding pixel data 
(reference pixel data) of a predicative picture, a DOT 
converter 1002 performing discrete cosine transforma- 
tion (DCT) processing, which is one of orthogonal trans- 
formation processing methods, on a signal (prediction 
error signal) outputted from the subtracter 1000. and a 
quantizer 1004 which quantizes a signal (DCT coeffi- 
cient) outputted from the DCT converter 1002. 

As described later in detail, pictures include various 
types such as I. P and B pictures, and prediction sys- 
tems are varied depending on the types of the pictures. 
The I pictures are subjected to Intra-frame or Intra-field 
encoding, so that input pixel data themselves are 
encoded. The P pictures are subjected to inter-frame or 
inter-field predictive encoding from past reproduced pic- 
tures. The B pictures are predicted through either or 
both of past reproduced pictures and future reproduced 
pictures (frame or field). The B pictures are predictively 
encoded (prediction-encoded) using the I and P pic- 
tures. The B pictures are not employed as reference pic- 
tures. 

In the case of inter-frame or inter-field prediction, 
motion compensation is carried out. Blocks in prediction 
pictures having the highest correlation with blocks (seg- 
ments serving as processing units) of the current pic- 



ture are otstained so that predictive encoding is earned 
out using the blocks having the highest correlation. Dis- 
placements between the current and prediction picture 
blocks are obtained as motion vectors, which are 

5 appended to respective pixel data blocks and transmit- 
ted. In general, the motion compensation is executed in 
units of blocks (segments) of 1 6 by 1 6 pixels. 

TTie DCT converter 1002 generally executes DCT 
processing in units of blocks of 8 by 8 pixels. Spatial 

10 redundancy (high correlation between adjacent pixels) 
in the pictures is reduced by the DCT processing. 
Namely, It is possible to make DOT coefficients localized 
in a low-frequency coefficient region by carrying out the 
DCT processing in the DCT converter 1002. thereby 

75 enabling reduction of the picture data quantity through 
processing by quantizer 1004 at the next stage. 

In a quantization table 1012, great values are set for 
high-frequency components. The quantizer 1004 quan- 
tizes the DCT coefficients received from tiie DCT con- 

20 verter 1002 with reference to the quantization table 
1012, whereby low-frequency components can be 
increased in value and high-frequency components can 
be substantially zeroed in both of horizontal and vertical 
directions in the spatial frequencies. Thus, the data 

25 quantity is reduced. 

The encoding unit further includes a zigzag scan- 
ner 1006 which sequendzes the quantized data 
received from the quantizer 1004 in prescribed order in 
a zigzag fashion, a variable length encoder 1008 which 

30 variable-length encodes the data received from the zig- 
zag scanner 1008. and a transmission encoding circuit 
1010 which receives the variable-length encoded data 
from the variable length encoder 1008. motion vector 
information from a motion vector detector (not shown) 

35 and information Indicating attributes of other blocks and 
variable-length encodes the motion vector information 
and the attribute information in accordance with a pre- 
scribed format for outputting while adding error oode 
words etc. tiiereto. 

40 As shown in a block 1 01 5 on the left side of Fig. 27. 
the zigzag scanner 1006 sequendzes 8 by 8 DCT coef- 
ficients in a zigzag manner successively from the upper 
left portion to the lower right portion (I.e., high-frequency 
component region). Among the DCT coefficients shown 

4s in the DCT coefficient biock 1015 of Fig. 27, the upper- 
most left one is called a DC coefficient indicating the 
average value of data of block of 8 by 8 pixels, while the 
remaining DCT coefficients are called AC coefficients. 
Nonzero coefficients are efficiently caught by zigzag- 

50 scanning the DCT coefficients by the zigzag scanner 
1006. 

The variable length encoder 1008 successively 
two-dim ensionally variable-length encodes the quan- 
tized DCT coefficients received from the zigzag scanner 
55 1006 with respect to both the number (runs) of prece- 
dent zero coefficients (nidi coefficients) and values (lev- 
els) of the nonzero coefficients (significant coefficients). 
This variable length encoder 1008 variable-length 
encodes tiie quantized DCT coefficient data received 
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from the zigzag scanner 1006 through a coding table 
1014 which Is developed along Huffman codes, for 
example. In the quantized DCT coefficients, many zeros 
are present in high-frequency components, and many of 
significant coefficients are present in low-frequency 5 
corrponents. Codes of small lengths are allotted to the 
significant coefficients while codes of large code lengths 
are allotted to quantized coefficients having small 
appearance frequencies, thereby further reducing the 
data quantity. 10 

Fig. 28 illustrates exenrplary arrangement of pic- 
tures transmitted from the transmission encoding circuit 
1010 shown in Fig. 27. 13 pictures having picture num- 
bers 1 to 13 are illustrated in Fig. 28. The pictures of 
Nos. 1 and 1 3 are I pictures, and the pictures of Nos. 4, is 
7 and 10 are P pictures. Two B pictures are inserted 
between an I picture and a P picture or between a pair 
of P pictures. The I pictures are subjected to only intra- 
frame encoding with no predictive encoding. The P pic- 
tures are subjected to inter-frame or inter-field predic- 20 
tive encoding (with motion compensation), and the B 
pictures are bidirectionally prediction-encoded (with 
motion compensation), for example. The I pictures (I), 
the P pictures (P) and the B pictures (B) may be field 
pictures, or frame pictures. In prediction of the B pic- 25 
tares (B), interpolation is carried out with i and P pic- 
tures or P pictures which are precedent and subsequent 
thereto in time base, for exanple. The P pictures are 
subjected to predictive encoding (with motion compen- 
sation) with I pictures (I) or P pictures (P) which are 30 
precedent thereto in time base. Only the t and P pic- 
tures are employed as predictive pictures, wNle the B 
pictures (B) are not employed as predictive pictures. 

Fig. 29 illustrates the structure of one picture. 
Referring to Fig. 29, a single picture (field or frame) 3S 
1020 is divided into a plurality of segments called macro 
blocks. For the purpose of simplification, the picture 
1020 is divided into 32 macro blocks MB#1 to MB#32 in 
Fig. 29, for example. Processing of a moving picture is 
executed in units of the segments called macro blocks 40 
(in both of encoding and decoding). Each of the macro 
blocks MB#1 to MB#32 generally includes 256 pixels 
which are arranged in horizontal 1 6 pixels by vertical 1 6 
pixels. Therefore, the picture shown in Fig. 29 is formed 
by 1 28 by 64 pixels. 4S 

Fig. 30 schematically illustrates the structure (syn- 
tax) of a bit stream (plural bit widths) of picture data. 
Referring to Fig. 30. the bit stream is divided into a plu- 
rality of layers Including a sequence layer, a GOP (group 
of pictures) layer, a picture layer, a slice layer, a macro so 
block layer and a block layer. 

The block layer is formed by a block 1 100 including 
a region 1 100a including DCT coefficients, and a region 
1 100b storing an End Of Block (EOB) indicating an end 
of the block. The region 1100a stores DCT coefficient ss 
data of pixels of 8 rows and 8 columns serving as a unit 
of DCT processing. If the final AC coefficient of the 
region 1 100a Is a nonzero coefficient in this block 1 100, 



the end of block of the region 1100b may not be 
employed. 

The macro block includes a prescribed number of 
(six) blocks 1100. The macro block on the bit stream 
includes data blocks formed by the blocks 1 1 00, and a 
macro block header 1115 for variable-length encoding 
and storing data attributes, a motion vector etc. of the 
data blocks. 

The slice layer includes slices 1 120, each of which 
is formed by one or a plurality of macro blocks 1100 
concatenate in picture scan order. A slice header 1 125 
storing information indicating a vertical position of the 
slice on the screen and information such as a start code 
having a prescribed pattern indicating starting of the 
slice is provided at the head of the slice 1 120. This slice 
layer, which is the lowermost layer among those to 
which codes of prescribed patterns are allotted, is 
employed as the unit of resynchronization in error gen- 
eration. 

The picture layer includes pictures 1130, each of 
which is formed by a plurality of slices 1120. A picture 
header 1135 storing information indicating the type of 
the picture (I picture, P picture etc.) and information 
such as a start code indicating starting of the picture in 
a variable length symbol (variable length code word) is 
arranged at the head of the picture 1 1 30. 

The GOP layer includes GOPs 1 140 each including 
a plurality of pictures 1130. Each of the pictures 1130 
included in each GOP 1140 includes at least one \ pic- 
ture and zero or a plurality of P or B pictures. A GOP 
header 1145 storing information such as a GOP start 
code, a flag indicating that this GOP requires no refer- 
ence from picture data of a precedent GOP etc. is 
an-anged at the head of the GOP 1 140. 

The sequence layer includes sequences 1150, 
each of which is formed by one or a plurality of GOPs 
1 140 or one or a plurality of pictures 1 130. A sequence 
header 1 155 storing information such as the screen for- 
mat Is arranged at the head of the sequence 1 1 50. This 
sequence header 11 55 can be arranged at the head of 
every GOP 1140 included in the sequence 1150 (for 
allowing reproduction of pictures from an intermediate 
stage of the sequence). The sequence header 1155 
stores information such as a start code having a pre- 
scribed pattern indicating starting of the sequence, hor- 
izontal and vertical sizes of the pictures, a picture rate 
(picture display rates), a bit rate and contents thereof 
etc. 

Rg. 31 illustrates the relation between each picture 
and the slices. As shown In Fig. 31, a single picture 
1 130 includes a plurality of slices 1 120. The slice 1 120, 
which can have an arbitrary length, returns to the left 
end upon reaching the right end on the screen. 

Fig. 32 illustrates the data block structure of each 
macro block 1110. The macro block 1100 includes 
regions llOOaa to llOOad storing DCT coefficient data 
Y1 to Y4 for regions obtained by dividing the macro 
block into four portions, and blocks 1 100ae and 1 lOOaf 
including subsampled chrominance signals Cb5 and 
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Cb6 respectively. The chrominance blocks 1 100ae and 
1100af are subsampled in the vertical and horizontal 
directions, whereby the four luminance blocks 1 1 0Oaa 
to 1100ad and one chrominance block 1100ae (or 
llOOaf) have the same dimensions on the screen. 5 
Motion compensation is executed in units of the macro 
blocks 1110 (MB) each of 16 by 16 pixels, while DCT 
processing is executed in units of blocks each of 8 by 8 
pixels. 

Rg. 33 schematically illustrates the structure of a 10 
conventional picture decoding circuit 1200. The picture 
decoding circuit 1200 shown in Fig. 33 expands picture 
data which are encoded by the encoding unit shown in 
Fig. 27 and restores the original picture data. 

Referring to Fig. 33, the picture decoding circuit is 
1200 includes a FIFO interface 1210 receiving an 
incoming bit stream (plural bit width) and storing/read- 
ing the same in/from an external memory 1230 in a 
FIFO (first-in first-out) fashion, a variable length decoder 
1212 variable-length decoding pixel data which are sup- 20 
plied through the FIFO interface 1210 in units of seg- 
ments (macro blocks) and generating quantized DCT 
coefficient data (quantized indices) of fixed length data, 
an inverse quantizer 1214 inverse-quantizing the data 
oulputted from the variable length decoder 1212 and 25 
generating DCT coefficient data, a scan converter 1216 
sequencing the data outputted from the Inverse quan- 
tizer 1 21 4 for generating DCT coefficient data which are 
arranged in scan order, an inverse discrete cosine con- 
verter 1218 executing inverse discrete cosine transfer- 30 
mation, which is one of inverse orthogonal 
transformation methods, on the data outputted from the 
scan converter 1216, and a pixel reconfigurator 1220 
receiving pixel data (differential data] outputted from the 
inverse discrete cosine converter 1218 and predictive 35 
picture pixel data supplied from the external memory 
1230 through a memory interface 1224 for restoring 
(reconfigurating) original pixel data. 

The FIFO interface 1210 accesses the external 
memory 1230 through the memory interface 1224 to 40 
store/read the incoming bit stream in the FIFO fashion 
thereby buffering the incoming bit stream and eliminat- 
ing difference between the bit rate thereof and the data 
processing rate in the picture decoding circuit 1200. 

The variable lengtii decoder 1212 detects headers 4s 
of respective layers from the bit stream supplied through 
the FIFO interface 1210, analyzes the detected head- 
ers, and executes data processing of respective blocks 
(blocks included in macro blocks) in accordance with 
the results of the analysis. Thus, the variable length so 
decoder 1212 executes a header analysis operation 
and variable length decoding processing of quantized 
DCT coefficients. This variable length decoding 
processing includes processing of restoring quantized 
DCT coefficients of fixed lengths from variable-length ss 
encoded run-length data. 

The inverse quantizer 1214 inverse-quantizes the 
quantized DCT coefficients received from the variable 
length decoder through quantized data of a quantization 



table (quantization matrix: not shown) to restore or 
reconstruct the DCT coefficients. This quantization 
matrix may be written in a quantization table which is 
included in the inverse quantizer 1214 through the vari- 
able length decoder 1212. 

The scan converter 1216 receives zigzag-scanned 
DCT coefficient data, shown in Fig. 27. which are sup- 
plied from the inverse quantizer 1214, and re-arranges 
tile scan order thereof to the original order. The inverse 
discrete cosine converter 1218 performs inverse dis- 
crete cosine transformation processing on the DCT 
coefficient data which are supplied from the scan con- 
verter 1216, and restores prediction-encoded data. The 
pixel reconfigurator 1220 reads necessary prediction 
picture pixel data from the external memory 1230 
through the memory interface 1224 in accordance with 
motion vector data and macro block attribute data from 
the variable length decoder 1212. adds up the read pixel 
data with the differential pixel data supplied from the 
inverse discrete cosine converter 1218 to reconfigure 
original pixel data, and restores tiie original pixel data 
for storing the same in the Vernal memory 1230 
through the memory interface 1224. 

The processing in the pixel reconfigurator 1220 Is 
varied in correspondence to the I, P and B pictures. In 
the case of pixel data of pictures such as I pictures 
which are subjected to intra-frame encoding, pixel data 
supplied from the inverse discrete cosine converter 
1218 are picture data themselves and no predictive 
encoding is carried out, and hence the pixel reconfigu- 
rator 1 220 writes the pixel data which are supplied from 
tiie inverse discrete cosine converter 1218 in the exter- 
nal memory 1230 through the memory interface 1224. 
In case of pixel data of P or B pictures which are sub- 
jected to inter-frame or inter-field predictive encoding, 
pixel data which are supplied from the inverse discrete 
cosine converter 1218 to the pixel reconfigurator 1220 
are prediction error signals which are provided by the 
difference with reference to already decoded pixel data 
(predictive picture data). In this case, therefore, the pixel 
reconfigurator 1220 adds up corresponding predictive 
picture pixel data from the external memory 1 230 and 
the pixel data from the inverse discrete cosine converter 
1218 with each other, and writes the results of the addi- 
tion in the external memory 1230 through the memory 
interface 1224 again. 

The picture data written in the external memory 
1 230 are read in the raster scan order through the mem- 
ory interface 1224, and supplied to a display unit 
tiirough a picture display control circuit (not shown) 
through a pixel bus interface 1222. 

The aforementioned series of processing is exe- 
cuted in units of segments, similarly to the case of 
encoding. The inverse quantizer 1214, the scan con- 
verter 1216, the inverse discrete cosine converter 1218 
and the pixel reconfigurator 1220 are ppelined, in order 
to process the picture data at a high speed. 
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A control circuit 1226 corrtrols the access to the 
external memory 1230 and starting and stoppage of the 
pipeline stage. 

Fig. 34 illustrates storage areas of the external 
memory 1230 shown In Fig. 33. This external memory 
1230 is formed by a DRAM (dynamic random access 
memory), for example, and includes a FIFO area 1232 
storing an externally supplied bit stream in the FIFO 
fashion, a reference picture area 1234 storing reference 
(prediction) picture pixel data employed for prediction 
decoding (DPCM decoding) processing in the pixel 
reconfigurator 1230 (Fig. 33), and a display picture area 
1236 storing display picture data to be displayed on a 
display unit through the display control circuit (not 
shown in Rg. 33). The FIFO area 1230 is generally 
called a rate buffer for rate adjustment for absorbing dif- 
ference between the bit rate of the incoming bit stream 
and the data processing speed in the picture decoding 
circuit 1200 (Fig. 33). Due to the employment of the 
FIFO area 1232. it is possible to compensate for differ- 
ence in code quantity required in a unit time in picture 
expansion processing due to processing of variable 
length code word data while the transmission rate of the 
incoming bit stream is kept substantially constant. 

Fig. 35 illustrates an exemplary timing chart in rela- 
tion to control of the picture decoding circuit shown in 
Fig. 33. This figure shows a picture synchronizing signal 
which is a synchronizing signal indicating starting of an 
operation in units of frame or field pictures, and an MB 
synchronizing signal which is a synchronizing signal 
indicating starting of an operation in units of segments. 
The picture synchronizing signal, which Is a vertical 
synchronizing signal, for example, is supplied to the 
control circuit 1226 shown in Fig. 33 from the display 
control circuit (not shown). The control circuit 1226 out- 
puts the MB synchronizing signal in synchronization 
with the picture synchronizing signal. The cycle of the 
picture synchronizing signal has a constant value which 
is decided by a display rate of decoded picture data 
(pixel data read through the pixel bus interface 1222 
shown in Fig. 32) on the display unit. This display rate is 
decided by a level in the MPEG standard. The maxi- 
mum values of the number of horizontal pixels, the 
number of vertical pixels and the frame frequencies are 
standardized in the "(ever*. In a single picture, the 
number of divided macro blocks is previously deter- 
mined. Therefore, the number of MB synchronizing sig- 
nals asserted in a picture synchronizing signal cycle is 
determined by the pixel number of the picture, i.e.. the 
number of macro blocks in a single picture. This MB 
synchronizing signal is supplied to each circuit of the 
picture decoding circuit 1220 from the control circuit 
1 226 shown in Fig. 33. so that each circuit executes pre- 
scribed processing synchronously. 

Fig. 36 is a timing chart showing processing which 
is carried out in a segment unit processing section. This 
figure shows the picture decoding circuit as a decoder. 
An operation of this picture decoding circuit (decoder) is 
started in synchronization with the MB synchronizing 



signal. The variable length decoder 1212 (see Fig. 33) 
is activated in synchronization with the MB synchroniz- 
ing signal to detect and analyze headers from the bit 
stream supplied through the FIFO interface 1210, 
5 thereby deciding the processing to be subsequently 
executed. Then, decoding of actual data (hereinafter 
referred to as decoding of block data) of respective 
blocks of macro blocks is carried out In accordance with 
the processing operation decided by the header analy- 
ze sis. In parallel with the decoding operation in the 
decoder, executed is access to the external memory 
1 230, including writing of the bit stream in the FIFO area 
1232 shown in Rg. 34. reading of pixel data from the 
FIFO area 1232 as to the bit stream to be decoded, writ- 
es ing of the decoded picture data in the reference picture 
area 1234 or the display picture area 1236 (B pictures 
are not employed as reference (prediction) pictures), 
reading of data from the display picture area 1236 of the 
external memory for display of the picture data, and 
20 reading of predicting picture data employed for predic- 
tive encoding/decoding processing in the pixel reconfig- 
urator 1220 from the reference picture area 1234. 

Rg. 36 also shows the processing operation of a 
single macro block. In the following description, it is 
25 assumed that the term "segment" includes both of a 
macro block including a plurality of blocks, and a macro 
block header including attribute data of the macro block, 
and the term "macro block" simply includes a plurality of 
data blocks. 

30 A header analysis part decodes a header part of 
the segment, and decides processing to be subse- 
quently executed and attributes of the macro block to be 
processed. After the decoding of the header part of the 
macro block, luminance signals (Y signals) and chromi- 

35 nance signals Cb and Cr of respective blocks of the 
macro block are decoded. At this time, an operation of 
reconfiguring motion vectors from those obtained by the 
decoding of the macro block header part is carried out 
in parallel (a plurality of nrtotion vectors are employed in 

40 the case of B pictures). An exemplary decoding opera- 
tion of such a decoder Is described in "A Single-Chip 
MPEG2 Video Decoder LSI" by Demura et al.. ISSCC 
94, Digest of Technical Papers, pp. 72 to 73, Fig. 2. for 
example. In the case of this processing, therefore, the 

45 time required for the header analysis depends on the 
length of the header part, and hence the period of the 
MB synchronizing signal, i.e., the time length of a single 
processing section differs for different processing sec- 
tions. 

so In the picture decoding circuit, the bit stream is 
processed in units of segments. As shown in Fig. 30, 
headers are provided on heads of the respective layers 
excluding the block layer. Start codes indicating starting 
of the layers are arranged on the head portions of the 

55 headers. Each start code 1300 has a width of 32 bits 
which are arranged in units of bytes, as shown in Rg. 
37. 

Referring to Fig. 37. the start code 1300 includes a 
3-byte prefix 1310 having a prescribed pattern indicat- 
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ing that this is a start code, and a 1 -byte layer start code 
1320 having a pattern which is specific to each layer. 
For example, a start code indicating starting oi a picture 
layer of the MPEQ2 standard has the following pattern: 

0000 0000 0000 0000 0000 0001 0000 0000 5 
while a start code indicating starting of a sequence layer 
has the following pattern: 

0000 0000 0000 0000 0000 0001 101 1 001 1 
In the aforenfientioned start codes, the prefix is formed 
by upper 24 bits (3 bytes), and the layer start code is w 
formed by a lower byte (8 bits). 

In the MPEG2 standard, header information is 
arranged following the start code in each layer which is 
higher In order than the macro block layer. No start code 
Is arranged on the macro block layer. The header infor- is 
mation is fixed length data, while detailed description 
thereof is omitted. The header (macro block header) of 
the macro block layer includes variable-length encoded 
information. 

Rg. 38 illustrates an exemplary structure of a ^ 
macro block header 1350. Refemng to Fig. 38, the 
macro block header 1350 includes a macro block 
address area 1352 storing information (a macro block 
address) indicating the position of the macro block on 
the screen and the number of macro blocks to be 25 
skipped (macro block address increment), an area 1354 
storing a macro block type indicating a method of 
processing the macro block, an area 1356 storing 
motion vectors of the macro blocK and a CBP area 
1358 storing CBP (coded block pattern) indicating 30 
whether or not respective blocks of the macro block 
other than in I pictures Include DCT coefficient data. 

The macro blocks which are skipped by the macro 
block address increment are those having no codes of 
DCT coefficients among those subjected to no motion 35 
compensation as to P pictures, for example. The macro 
block type stored in the area 1354 includes information 
as to whether or not the macro block is subjected to 
intra-frame/intra-field predictive encoding, whether or 
not the same is subjected to motion compensation, and 40 
the like. 

The motion vector area 1356 stores motion vectors 
in the case of motion compensated prediction. In the 
case of I pictures, no motion vectors are stored in the 
motion vector area 1 356. In relation to P pictures, on the 4S 
other hand, motion vectors along a prediction system 
(odd and even fields (top and bottom fields) in the case 
of frame predictive encoding system) can be employed. 
Also as to B pictures, the number of employed motion 
vectors varies according to the prediction system, so 
Therefore, the bit width of the motion vector storage 
area 1356 differs for different segment. Therefore, a 
block as to which the information stored in the CBP area 
1358 indicates inclusion of no DCT coefficient data is 
absent in data transmission. ss 

The information included in the respective areas 
1352, 1354, 1356 and 1358 of the macro block header 
1350 is entirely expressed by variable length code 
words (variable length symbols). Therefore, the time 



required for entirely analyzing the information of the 
macro block header 1350 varies according to the 
attributes of the macro blocks (the method of process- 
ing, the number of the motion vectors etc.). 

It Is possfole to specify what processing Is candied 
out on the macro block following the macro block header 
1350 by analyzing the header information. In general, 
analysis of the information of the macro block header 
1350 is started in synchronization with the MB synchro- 
nizing signal (MBSYNC) as shown in Fig. 36, so that 
decoding of the macro block data is performed only 
after the information of the macro block header 1350 is 
entirely analyzed. Namely, a code decoding part of the 
variable length decoder 1212. the inverse quantizer 
1214. the scan converter 1216, the inverse discrete 
cosine converter 121 8 and the pixel reconfigurator 1220 
shown in Fig. 33 are kept in operation stoppage states 
after the MB synchronizing signal (MBSYNC) Is 
asserted until the information of the macro block header 
1350 is entirely analyzed, and these operational proces- 
sors are brought into operating states only after the 
nnacro block header information is entirely analyzed. 
Fig. 39 Illustrates such a state that headers of macro 
blocks MB#A. MB#B and MB#C are completely ana- 
lyzed at times Ta, Tb and Tc respectively, and then block 
data are decoded, for example. 

Therefore, w^en a long time is required for the 
header analysis in the macro block MB#C, for ecanrple, 
the operation stoppage times of the operational proces- 
sors following the variable length code decoder are so 
increased that utilization efficiency of the operational 
processors is reduced and the picture data cannot be 
decoded at a high speed. 

In order to prevent such reduction in utilization effi- 
ciency of the operational processors, the operational 
processing may conceivably be carried out in a pipeline 
manner. 

Fig. 40 schematically illustrates a pipeline which is 
defined by respective stages of operational processors 
from an inverse quantizer to a pixel reconfigurator. In 
the structure shown in Fig. 40, variable-length decoded 
data having header analyzed are dispatched into the 
pipeline every assertion of MB synchronizing signal 
MBSYNC. Inverse quantization, scan conversion, 
inverse DCT and pixel decoding stages in the pipeline 
stages process the supplied data in a pipeline nrxxle 
respectively. 

When header analysis and variable length decod- 
ing of the segment (the macro block header and the 
macro block) MB#A are completed and a next MB syn- 
chronizing signal MBSYNC is asserted, the respective 
block data of the macro block MB#A are dispatched into 
the pipeline and successively processed. 

If a long time is required for header analysis of the 
next segment MB#B, data of the macro block MB#B are 
not yet introduced into the pipeline upon corrpletion of 
data processing of the respective blocks of the macro 
block MB#A. Thus, vacancy is caused in the pipeline 
stages and pipeline utilization efficiency is reduced. 
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When header analysis and variable length decod- 
ing of the segment MB#B are completed, the data of 
variable length decoded words of the macro block 
MB#B are dispatched into the pipeline stages in accord- 
ance with assertion of a next MB synchronizing signal 5 
MBSYNC. 

If header analysis of the next segment MB#C is 
completed In a short time and variable length decoding 
for data of respective blocks of the macro block MB#C is 
also quickly completed correspondingly, a next MB syn- 10 
chronizing signal MBSYNC is asserted following com- 
pletion of the variable length decoding of the macro 
block MB#C. If data processing of the respective blocks 
of the macro block MB#B is not yet completed in the 
inverse quantization stage of the pipeline at this time, is 
block data of the next macro block MB#C are dis- 
patched during data processing of the respective blocks 
of the macro block MB#B. Thus, the data of the respec- 
tive blocks of the macro blocks MB#B and MB#C are 
mixedly processed, and the data processing (expansion 20 
processing) cannot be correctly performed but breaks 
down. Thus, a large pipeline cannot be Introduced, and 
improvement of utilization efficiency of the operational 
processors through the use of the pipeline is limited. 

In a picture decoding circuit for processing moving 25 
picture data, particularly data of pictures having a large 
screen size of HDTV (high definition television] or the 
like, it is necessary to process a large quantity of data at 
a high speed (the frequency of a frame or a field, i.e., 
the cycle of this picture synchronizing signal is decided 30 
by the display speed for the picture data after expan- 
sion), and the amount of operations at operational proc- 
essors (such as an inverse DCT converter, for example) 
in the expansion procedure becomes extremely targe. 
In order to compensate for reduction of utilization effi- 35 
ciency of the operational processors and implement 
high-speed data processing, therefore, it is necessary 
to increase the operating speeds of the respective oper- 
ational processors (increase the frequencies of clock 
signals deciding the operational processing speeds). 40 
Thus, the number of on and off times of the elements 
forming the operational processors and the number of 
charging and discharging times of signal lines per unit 
time are increased, leading to increase of current con- 
sumption. 45 

As another method, it is also conceivable to provide 
a plurality of operational processors in parallel with each 
other and simultaneously drive the same in parallel with 
each other thereby compensating for reduction of utili- 
zation efficiency. In this case, however, the element so 
number is disadvantageously increased to increase the 
device scale. 

When interruption processing from an external con- 
trol unit is caused during the picture expansion proce- 
dure, for example, it is necessary to initialize the picture ss 
decoding circuit after completion of the interruption. If 
the processing is restarted from the interrupted state, 
however, display is performed from an intermediate 
stage of the picture. In this case, it may be impossible to 



synchronize processing of the subsequent picture with 
tiie display on the display unit. If first picture display is 
executed immediately after initialization in synchroniza- 
tion with the picture synchronizing signal such as the 
vertical synchronizing signal, for example, pictures out 
of synchronization are thereafter displayed (boundaries 
between the pictures are displayed on the screen). In 
tiie MPEG standard, a sequence header is arranged on 
the head of each GOP (group of pictures) to allow repro- 
duction from an arbitrary GOP. However, no processing 
to be executed in resetting (initialization) of the picture 
expansion procedure is mentioned. Further, no prior art 
mentions such an operation of initialization of picture 
expansion processing. 

SUMMARY OF THE INVENTION 

An object of the present invention is to provide a 
picture decoding circuit which can efficiently execute 
expansion of picture data. 

Another object of the present invention is to provide 
a picture decoding circuit including an efficiently operat- 
ing pipeline stage. 

Still another object of the present invention Is to 
provide a picture decoding circuit which is excellent in 
utilization efficiency of operational processors. 

A further object of the present invention is to pro- 
vide a picture decoding circuit which can reliably exe- 
cute processing from a first macro block of a picture in 
resetting (in initialization and re-synchronization) with- 
out reducing processing efficiency. 

A picture decoding circuit according to a first aspect 
of the present invention includes a header decoder 
receiving an incoming bit stream and analyzing informa- 
tion of a header of a segment, a controller generating a 
data processing start indication signal in response to a 
signal indicating completion of analysis of the segment 
header information from the header decoder, and a data 
processor which is activated in response to the data 
processing start indication signal for executing predeter- 
mined processing on a data block of the segment follow- 
ing the header. The header decoder continuously 
analyzes data of a header which Is supplied following 
the data block, whereby one processing section is 
started from processing of the data block and ended in 
analysis of the header. 

A picture decoding circuit according to a second 
aspect of the present invention includes an analyzer 
detecting a header of a segment from a supplied bit 
stream for analyzing this header information. This ana- 
lyzer Includes a circuit generating a signal indicating 
completion of analysis of all the header information. 

The picture decoding circuit according to the sec- 
ond aspect further includes a data processor including a 
portion for generating fixed length code data by carrying 
out variable length decoding on data of a data block fol- 
lowing the header of the segment for restoring the data 
of the data block in accordance with the result of analy- 
sis of the analyzer, an error detector generating an error 
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detection signal indicating an error which is detected in 
the processing o1 either the analyzer or the variable 
length decoder, code detector detecting a start code 
having a predetermined pattern from the incoming bit 
stream in response to the error detection signal, an acti- 5 
vator activating the analyzer in response to a code 
detection signal from the code detector, and a delayer 
for delaying activation of the data processor until pre- 
scribed conditions are satisfied In response to an analy- 
sts completion indication signal from the analyzer in w 
activation of the error detector. 

A picture decoding circuit according to a third 
aspect of the present invention includes a controller 
generating a processing start signal in response to a 
reset request signal requesting initialization of picture is 
expansion processing, code detector detecting a start 
code having a predetermined pattern from an incoming 
bit stream in response to the processing start signal 
from the controller, a header analyzer detecting a seg- 
merrt from the incoming stream in response to a code 20 
detection signal from the code detector in code detec- 
tion for analyzing information of its header and generat- 
ing a signal indicating that all analysis of the head 
information is completed, and a stop control for stopping 
the operation of data processor carrying out processing 2s 
of a data block of the segment until prescribed condi- 
tions are satisfied in response to the header analysis 
completion indication signal. 

In the picture decoding circuit according to the first 
aspect, the header is analyzed following decoding of the 30 
data block, and starting of data processing is instructed 
after the header is entirely analyzed. One processing 
section is started at processing of the data block and 
ended at analysis of the header. When the data 
processing start is designated, the data processor 3S 
immediately executes processing. Therefore, the stop 
period of the operational processor is reduced and the 
utilization efficiency thereof is improved. Further, the 
standby time of the operational processor is reduced, 
whereby the time period of one processing section can 40 
be reduced to implement high-speed processing. 

In the picture decoding circuit according to the sec- 
ond aspect, a start code having a prescribed pattern is 
detected when an error is caused in a header analysis 
or variable length decoding process and the header of a 4S 
segment following the start code is analyzed, and the 
start of processing of a data block following the ana- 
lyzed header is delayed until a presaibed condition is 
satisfied after completion of the analysis. Processing is 
started from a prescribed segment even in occurrence so 
of an error and the processing section is started at 
processing of the data block in the restarting of the 
processing, whereby reduction of utilization efficiency of 
the operational processor can be also suppressed in 
starting of the processing after recovery from the error, ss 
Further, it is possible to maintain such regularity that the 
processing section is started at decoding of the data 
block. 



In the picture decoding circuit according to the third 
aspect, a start code having a prescribed pattern is 
detected upon request for resetting, and a header of a 
segment following the start code is analyzed and the 
subsequent processing is stopped until establishment 
of the prescribed condition. Also in request for resetting, 
processing can be reliably started from a macrc) block of 
a segment of a desired position. 

The foregoing and other objects, features, aspects 
and advantages of the present Invention will become 
more apparent from the following detailed description of 
the present invention when taken in conjunction with the 
accompanying drawings. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 schematically illustrates an operation in one 
processing section of a picture decoding circuit 
according to the present invention; 
Rgs. 2A and 2B illustrate the structure of one 
processing section (unit) of the picture decoding cir- 
cuit according to the present invention and an effect 
of pipeline arrangement: 

Rg. 3 illustrates the operations of one processing 
section of the picture decoding circuit arxi a DRAM 
port according to the present invention; 
Rg. 4 illustrates other operation sequences of the 
picture decoding circuit and the DRAM port accord- 
ing to the present invention; 
Rg. 5 illustrates structures of input and output sig- 
nals in and from an inverse quantizer which is 
employed in the picture decoding circuit according 
to the present invention; 

Rg. 6 illustrates the relations between the input and 
output signals of the inverse quantizer shown in Rg. 

5; 

Rg. 7 illustrates a pipeline structure of operational 
processors of the picture decoding circuit according 
to the present invention and a processing sequence 
for block data; 

Rg. 8 Is a flow chart representing an operation for 
setting the time period of one processing section in 
the picture decoding circuit according to the present 
invention; 

Rg. 9 illustrates another operation sequence for 
deciding one processing section in the picture 
decoding circuit according to the present invention; 
Rg. 10 is a flow chart representing an operation in 
an error state in the picture decoding circuit accord- 
ing to the present invention; 
Rg. 11 illustrates the structures of a header of a 
segment and a start code accompanying the same 
employed in the present invention; 
Rg. 12 illustrates the structure of a part of the pic- 
ture decoding circuit according to the present 
invention which is related to the operation in an 
error state; 

Rg. 13 illustrates an operation sequence of the 
structure shown in Fig. 12 in an en-or state; 
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Fig. 14 illustrates another operation sequence of 

the structure shown in Rg. 12 In an error state: 

Fig. 1 5 illustrates the internal structure of a variable 

length decoder shown in Fig. 12; 

Fig. 16 is a block diagram showing the internal s 

structure of a control unit shown in Fig. 12; 

Fig. 17 illustrates the structure of a pixel reconfigu- 

rator in the picture decoding circuit according to the 

present invention; 

Fig. 18 illustrates an operation sequence in an error io 
state in the picture decoding circuit according to the 
present invention; 

Fig. 19 illustrates an error concealment processing 

in the picture decoding circuit according to the 

present invention; is 

Fig. 20 illustrates another structure of the pixel 

reconfigurator in the picture decoding circuit 

according to the present invention; 

Fig. 21 illustrates the structure of a scan converter 

shown in Fig. 20; 20 

Fig. 22 illustrates still another operation sequence 

in an error state in the picture decoding circuit 

according to the present invention; 

Fig. 23 illustrates an error concealment processing 

in the operation sequence shown In Fig. 22; 2s 

Fig. 24 is a flow chart representing an operation in 

resetting (restarting) of the picture decoding circuit 

according to the present invention; 

Fig. 25 is a flow chart representing an operation in 

resetting Gnitialization) of the picture decoding dr- 30 

cuit according to the present invention; 

Fig. 26 illustrates an exemplary operation sequence 

In resetting of the picture decoding circuit according 

to the present invention; 

Fig. 27 illustrates a structure for generating a varia- 3S 
ble length code which the present invention proc- 
esses; 

Fig. 28 illustrates a picture arrangement in a GOP 
layer utilized in a picture decoding circuit to which 
the present invention is applied; 40 
Fig. 29 illustrates the structure of picture data to 
which the present invention is applied; 
Fig. 30 illustrates the syntax of picture data to which 
the present invention is applied; 

Fig. 31 illustrates a slice layer shown in Fig. 30; 4s 
Fig. 32 illustrates the structure of a block layer 
shown in Fig. 30; 

Fig. 33 is a block diagram schematically showing 
the structure of a picture decoding circuit to which 
the present Invention is directed; so 
Fig. 34 illustrates the structure of storage areas of 
an external memory shown in Fig. 33; 
Fig. 35 illustrates a processing section of a conven- 
tional picture decoding circuit; 

Fig. 36 illustrates an operation of the conventional ss 

picture decoding circuit; 

Fig. 37 illustrates the structure of a start code; 

Fig. 38 illustrates the structure of a header part of a 

macro block layer; 



Rg. 39 illustrates a problem in the conventional pic- 
ture decoding circuit; and 

Fig. 40 illustrates another problem in the conven- 
tional picture decoding circuit. 

DESCRIPTION OF THE PREFERRED EMBODI- 
MENTS 

Rg. 1 illustrates an operation in one processing 
section PS1 of a variable length decoding part in a pic- 
ture decoding circuit according to the present invention. 
The processing section PS1 of a variable length decod- 
ing part (hereinafter referred to as a decoder (VLD)) 
includes a decoding period PS2 for decoding data of 
respective blocks of a macro blocK and a period PS3 
following the decoding period PS2 for analyzing header 
Information. The decoding period PS2 is started in 
response to assertion of an MB synchronizing signal 
MBSYNC, to decode the block data consisting of a var- 
iable length symbol group on the basis of a quantization 
index. In the header analysis period PS3. information of 
a header part (sequence and picture headers may be 
included in addition to a macro block header) for a next 
processing section is entirely analyzed. After comple- 
tion of the analysis period PS3, i.e., after completion of 
analysis of all information of the next macro block 
header, starting of the next processing section PS1 , i.e.. 
decoding processing of data of blocks of the next macro 
block, is delayed until prescribed conditions are estab- 
lished. Referring to Fig. 1 , the block data of the next 
macro block are decoded following completion of the 
analysis period PS3. However, the time period of the 
analysis period PS3 varies depending on the header 
information. Decoding processing of encoded block 
data (the data of the respective blocks of the macro 
block) is completed in a fixed constant time. The data of 
the respective blocks of the macro block are variable- 
length encoded, with different code lengths. When the 
variable length codes are decoded at a 1 symbol/1 clock 
cycle rate, for example, each block of the macro block 
has 8 by 8 pixels, and the maximum number of the sym- 
bols per block is 64. When the time period of the decod- 
ing period PS2 is set in the aforementioned manner, 
tiierefore, a fixed time length can be attained. When var- 
iable-length encoding is carried out at the rate of 1 sym- 
bol/1 clock cycle, run-length data are decoded and DCT 
coefficients of the respective blocks are successively 
obtained along the decoded run-length information. In 
this case, therefore, the maximum value of the time 
required for the run-length decoding can be previously 
determined, and rf the time required for such run-length 
decoding is previously set at a constant value and when 
DCT coefficient data of the blocks are obtained at a rate 
of one pixel per clock from the decoded run-length infor- 
mation, the time period is fixed also in this case. Also 
when the time required for the run-length decoding is 
varied and accordingly the time period of the decoding 
period PS2 fluctuates, the time period required for 
decoding the block data can be suppressed within a 
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constant time (about the maximum decoding time). The 
decoder (VLD) outputs DCT coefficients (quantization 
index) of f ixed lengths. 

According to the structure of the processing period 
shown in Fig. 1 . the following advantages are obtained: s 
The data of the blocks of the macro block are decoded 
in synchronization with the MB synchronizing signal 
MBSYNC. Therefore, each computing element included 
in the picture decoding circuit can start its operation 
after completion of header analysis with no standby io 
time. Therefore, an inverse quantizer, a variable length 
decoder, a scan converter, an inverse discrete cosine 
converter and a pixel reconfigurator can start process- 
ing with no delay (particularly when the elements con- 
struct a pipeline), whereby utilization efficiency of is 
various computing elements of the picture decoding cir- 
cuit can be improved. 

Further, the time periods of the decoding period 
PS2 and the analysis period PS3 can be remarkably 
reduced by driving various operational processors 20 
included in the picture decoding circuit in a pipeline 
manner as described later- 
Figs. 2A and 2B specifically illustrate the structure 
of each processing section. Referring to Rg. 2A, the 
decoding period PS2 of one processing section 25 
includes variable length decoding processing (VLD) for 
variable-length decoding variable length codes and 
generating quantized DCT coefficients of fixed lengths, 
inverse quantization processing (IQ) on the variable- 
length decoded DCT coefficient data, scan conversion 30 
processing carrying out conversion of scan order of the 
inverse-quantized DCT coefficients, inverse discrete 
cosine transformation processing (IDCT) of the scan- 
converted data, and pixel restoration processing 
{DPCM: differential PCM) for restoring original pixel 3s 
data from the pixel data after the inverse discrete cosine 
transformation. Referring to Fig. 2A, the time period of a 
decoding period in the processing section is the total 
sum of times required for the respective processing 
operations. 

Rg. 2B illustrates an exemplary structure in the 
case of executing the respective processing operations 
included in the decoding period 2 in a pipeline manner. 
When the variable length decoding processing (VLD) is 
completed, the header information can be analyzed in 4S 
the variable length decoder. Therefore, header informa- 
tion of a next segment can be analyzed in parallel with 
the inverse quantization processing (IQ). the scan con- 
version processing (write/read of data to a buffer mem- 
ory, accompanying address conversion), the inverse sc 
discrete cosine transformation processing (IDCT) and 
the pixel restoration processing (DPCM). Thus, reduc- 
tion of the time periods of the decoding period PS2 and 
the analysis period PS3 can be implemented by carry- 
ing out the processing in the pipeline mode due to par- st 
altel processing of the header information analysis and 
decoding of block data through the pipeline, the time 
period for one processing section can be remarkably 
reduced, and high-speed arithmetic processing (expan- 



sion) can be executed. The structure of the pipeline is 
described later again in detail. 

The external structure of the picture decoding cir- 
cuit according to the present invention is schematically 
identical to the structure shown in Rg. 33. Internal struc- 
tures of a variable length decoder 1212 and a control 
circuit 1226 are different. These structures are 
described later in detail. 

Rg. 3 illustrates operations of the decoder (picture 
decoding circuit) and a port of an external memory 
device (DRAM). Referring to Rg. 3, decoding of block 
data of the segment is started in response to assertion 
of the MB synchronizing signal MBSYNC in the picture 
decoding circuit (decoder). When the decoding of the 
block data is completed, header information of the next 
segment is analyzed. One processing unit time period is 
just ended when analysis of the header information is 
completed, and decoding of block data of the macro 
block of the next segment is started. 

With respect to the DRAM, on the other hand, pixel 
data decoded in a precedent processing unit time 
period (section) are first written in response to assertion 
of the MB synchronizing signal MBSYNC. Then, an 
externally supplied bit stream is written in a predeter- 
mined time period through the FIFO interface 1210 
shown in Rg. 32. When the writing of the bit stream in 
the DRAM port (writing in a rate buffer) is completed, 
picture data for display are then read out. When the 
reading of the picture data for display (pixel data of the 
macro block, for example) is completed, predictive pic- 
ture data employed for restoration of prediction encoded 
pixel data are then read out. In such reading of the pre- 
dictive picture data, picture data of two pictures which 
are precedent and subsequent in time are read in the 
case of interpolation prediction, for example, in the case 
of B pictures. Therefore, the reading of the predictive 
picture data varies depending on the encoding mode of 
the block data to be decoded. 

When the reading of the predictive picture data is 
completed, the bit stream to be processed is then read 
out (reading of the rate buffer). In the reading of the rate 
buffer, the quantity of read data is previously set It is 
necessary that the bit stream employed for analysis of 
the header information in the processing unit carrying 
out reading of the rate buffer and the block data of the 
segment decoded in the next processing unit (section) 
are prepared in a buffer included in the variable length 
decoder which is described later. It is possible to guar- 
antee storage (prefetch) of the bit stream employed for 
the header analysis in the corresponding processing 
section and the block data employed in the next 
processing section in a buffer memory included in the 
variable length decoder by reading the bit stream from 
the rate buffer in each processing (unit) section. Here, 
one processing unit corresponds to one processing sec- 
tion. 

After the reading of the rate buffer. DRAM refresh- 
ing is canried out, and refreshing of memory data stored 
in the D RAM which is an external memory device is exe- 
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cuted. In the operation of the DRAM port, the aforemen- 
tioned operations are successively executed in a single 
processing unit time, in the operation sequence shown 
in Fig. 3, no access is made until the next processing 
section is started after completion of the DRAM refresh- 5 
ing operation, and the DRAM port enters an empty 
(wait) state. The DRAM refreshing Is illustrated as being 
carried out last in one processing section. However, this 
DRAM refreshing may be executed at proper timing in 
the section of one processing unit. 10 

Fig. 4 illustrates another sequence of operations of 
the picture decoding circuit and the DRAM port in one 
processing section. Referring to Rg. 4, decoding of the 
block data (data of the respective blocks of the macro 
block) is carried out in the picture decoding circuit is 
(decoder) in synchronization with assertion of the MB 
synchronizing signal MBSYNC similarly to the 
sequence shown in Fig. 3, and then header information 
of the next segment is carried out after completion of the 
decoding. In the sequence shown in Fig. 4, starting of 20 
decoding processing of the block data of the next seg- 
ment is delayed after completion of analysis of the 
header information. 

In the DRAM port, on the other hand, writing of 
decoded data, writing in the rate buffer, reading of pic- 25 
ture data for display, reading of predictive picture data 
and reading of the rate buffer are successively executed 
in synchronization with assertion of the MB synchroniz- 
ing signal MBSYNC. DRAM refreshing is executed 
before the reading of the rate buffer. This DRAM 30 
refreshing can be executed in one processing section at 
arbitrary timing, as described above. One processing 
section Is completed by completion of the reading of the 
rate buffer. In response to the connpletion of the 
processing section, the MB synchronizing signal 3S 
MBSYNC is asserted in order to instruct starting of 
decoding of the block data of the next segment. An 
empty period between the analysis of the head informa- 
tion and the starting of decoding of tiie next block data 
Is described later in detail. 40 

The writing of the decoded data, the writing in the 
rate buffer, the reading of the picture data for display, the 
reading of the predictive picture data and the reading of 
the rate buffer are carried out with respect to the DRAM 
port in the prescribed order in this processing section, 4S 
whereby it is not necessary to discriminate the priority of 
the accesses to the DRAM or to provide a bus arbiter for 
adjusting the accesses to the DRAM, and the device 
structure is simplified. 

Further, it is possible for the processing operations so 
to be adapted for the pipeline structure of the opera- 
tional processors of the picture decoding circuit 
described later in detail, by writing the decoded data 
first in the processing section. In addition, it is possible 
to prepare picture data which are necessary for the sub- ss 
sequently executed reading of the picture data for dis- 
play in the DRAM by writing the decoded data in 
advance. Namely, the decoded data are immediately 
displayed in the case of B pictures (the B pictures are 



not employed as predictive pictures). It is possible to 
write tiie bit stream in the rate buffer without changing 
the operation mode (write mode/read mode) of the 
DRAM and with no delay of the externally supplied bit 
stream by writing the bit stream in the rate buffer subse- 
quently to the writing of the decoded data. It is not nec- 
essary to stall the operation of the display control unit 
which is separately provided in the exterior, since the 
picture data for display are read in advance of the read- 
ing of the predictive picture data. Namely, the number of 
the predictive pictures to be read varies dep>ending on 
the processing method (predictive encoding) for the 
segment in the reading of the predictive picture data. 
Therefore, the time required for completion of the read- 
ing of the predictive picture data varies with the type of 
picture. Thus, it is possible to supply the display picture 
data to the display control unit substantially at the same 
timing In each respective processing section by reading 
the picture data for display in advance of reading of the 
predictive picture data having a different timing of com- 
pletion in one processing section, and utilization effi- 
ciency of the display control unit is not damaged. 

The bit stream is read from the rate buffer at the last 
of the processing section with no problem, since only 
supply to the variable length decoder (1212: see Rg. 
33) of a bit stream which is required for block data 
decoding processing and header analysis in the next 
section is required. The predictive picture data are read 
in advance of the reading of the rate buffer, so that the 
predictive picture data can be reliably loaded in the 
buffer memory which is provided in the pixel reconfigu- 
rator of the picture decoding circuit and the arithmetic 
processing of forming the predictive pictures can be reli- 
ably executed subsequently in synchronization witii 
starting of the next processing section. 

The access to the DRAM port is started in synchro- 
nization with the MB synchronizing signal MBSYNC, 
whereby the read timing for the predictive picture data 
can be previously predicted and bus corrtrol is simplified 
(access control to the DRAM is earned out by the con- 
trol circuit 1226 shown in Fig. 32, the structure of which 
is described later in detail). Namely, it is possible to rec- 
ognize the type of the macro block and its position on 
the screen by analyzing the header irrformation in 
advance. The DRAM has the structure of a frame mem- 
ory. Therefore, it is possible to previously predict change 
of row addresses etc. in the writing of the decoded data 
and the reading of the picture data for display by analyz- 
ing the header information in advance, whereby the 
times required for the writing of the decoded data and 
the reading of the picture data for display can be pre- 
dicted in response and the read timing for the predictive 
picture data can be predicted in response. Thus, control 
of the memory interface shown in Fig. 32 and the load- 
ing operation of the predictive picture data In the pixel 
reconf igurator can also be arbitratedly carried out. 

Rg. 5 schematically illustrates the structure of the 
Inverse quantizer forming the pipeline In units of clock 
cycles. This inverse quantizer 1214 receives quantized 
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DCT coefficient data consisting of variable-length 
decoded fixed length data through an input bus A101 
while receiving an input synchronizing signal irKlicating 
starting of each block (each block of the macro block) 
through a signal line A1 03. candies out inverse quantiza- 5 
tion processing in a pipeline mode, and outputs DCT 
coefficient data from an output bus A102 while output- 
ting an output synchronizing signal indicating starting of 
the block of the output data through a signal line A104. 

The inverse quantizer 1214 carries out arithmetic 10 
processing inverse to that in quantization on the quan- 
tized DCT coefficients which are converted to fixed 
length codes using a previously prepared quantization 
table (for example, It carries out multiplication with cor- 
responding coefficients of the quantization table: when is 
division is made by corresponding coefficients of the 
quantization table in quantization). At this time, multipli- 
cation processing is executed in a pipeline manner. In 
general, this inverse quantizer 1214 comprises a pipe- 
line having 1 28 extra stages as compared with the VLD, 20 
IDCT and DPCM processing stages, as shown in Rg. 6. 
When the input synchronizing signal is supplied through 
the signal line A103 and the data are successively sup- 
plied through the input bus A101 as shown in Rg. 6, 
therefore, inverse-quantized data are outputted after a 2S 
lapse of 128 cycles. The input data supplied to the 
inverse quantizer 1214 are provided by the variable 
length decoder 1212 shown in Rg. 33. Before all output 
data appearing at the output bus A102 from the inverse 
quantizer 1214 are outputted. or before the same are 30 
supplied to an inverse DCT device through the scan 
converter as shown in Rg. 2B, the input data are ended 
in advance of at least 128 cycles. During this period, 
therefore, the variable length decoder can be utilized for 
header analysis. Thus, the processing following the 35 
inverse quantizer and the header analysis can be exe- 
cuted in parallel with each other (see Fig. 20). 

Rg. 7 illustrates another pipeline mode for the pic- 
ture decoding circuit In the picture decoding circuit 
shown in Fig. 7, pipeline processing Is executed by a 40 
pipeline of four stages in synchronization with the MB 
synchronizing signal MBSYNC. Refen-ing to Fig. 7, the 
first stage pipeline reads a predictive picture from the 
DRAM, variable-length decodes the DCT coefficients 
(formation of fixed length DCT coefficient data), and 4S 
carries out inverse quantization processing. In the read- 
ing of the predictive picture data from the DRAM, motion 
vectors are extracted from header information analyzed 
in a precedent processing section, so that the predictive 
picture data are read from the DRAM in accordance so 
with the extracted motion vectors. 

The second pipeline stage carries out filter 
processing of the predictive picture data read from the 
DRAM. In the filter processing of the predictive pictures, 
a plurality of predictive pictures in tiie case of fractional ss 
prediction accuracy are synthesized (averaged) by 
interpolation. In the case of B pictures of interpolation 
prediction, picture data of two pictures which are prece- 
dent and subsequent in time are synthesized with each 



other (the picture data are synthesized with weighting 
according to respective time distances). Thus, the pre- 
dictive picture data are formed. 

The third pipeline stage carries out inverse discrete 
cosine transformation processing (IDCT) and predictive 
difference code decoding processing (DPCM decod- 
ing), in the IDCT processing, inverse discrete cosine 
transformation processing of DCT coefficient data sub- 
jected to inverse quantization processing (IQ) is exe- 
cuted. In the DPCM decoding process, predictive 
differential encoding (addition) of pixel data formed by 
the IDCT processing and predictive picture data formed 
by predictive picture filter processing is carried out, to 
form original pixel data. When the macro blocks are I 
pictures, the IDCT processed data correspond to the 
original pixel data (when no DC prediction is made). The 
DPCM decoded and restored pixel data are written In 
the buffer which is included in the picture decoding cir- 
cuit. 

The fourth pipeline stage writes the decoded pic- 
ture data in the DRAM. Namely, writing into the DRAM 
is carried out from the txiffer. 

It is possible to remarkably reduce the time period 
of the processing unit by can-ying out the processing of 
the picture decoding circuit, following the header analy- 
sis in a pipeline manner in units of segments (macro 
blocks). Assuming that the MB synchronizing signal 
MBSYNC is asserted at an interval of one processing 
section in Rg. 7, and therefore four processing sections 
are required for decoding block data of one macro block. 
Analysis of the header information is executed in each 
processing section. Fig. 7 shows an operation 
sequence in the case of processing a digital NTSC sig- 
nal (720 valid pixels/line, 480 lines/frame) in units of 
macro blocks each consisting of 16 by 16 pixels every 
frame, for example. First to 1350-th macro blocks MB#1 
to MB#1350 are processed by the four stage pipelines 
In the units of segments (one segment (macro block) is 
processed in one processing section). 

Rg. 7 also shows access to the DRAM port In the 
case of carrying out the internal arithmetic processing 
operation in the picture decoding circuit in a pipeline 
manner, in correspondence to the pipeline stages in the 
picture decoding circuit. 

As shown in Fig. 7. processing of the segments 
which are the units of picture expansion processing can 
be executed in a pipeline manner over a plurality of 
processing sections due to the pipelined processing of 
the respective operational processors of the picture 
decoding circuit in units of segments, whereby the time 
required for all processing of one segment (time for one 
processing unit) can be effectively-reduced. As shown 
in Fig. 7, one segment is processed in a processing sec- 
tion of a time of about 1/4 one processing unit, in the 
case of the four stage pipeline structure. 

The time period of the processing section shown in 
Fig. 7 may be fixed to a constant dock cycle number. 
However, it is also possible to change the time period 



12 



23 



EP 0 731 422 A2 



24 



(clock cycle number) of the processing section in 
accordance with the attributes of the segment. 

Fig. 8 illustrates an operation flow for changing the 
time period of the processing section. With reference to 
Fig. 8. a method for changing the clock cyde number of s 
the processing section Is now described. 

First, the MB synchronizing signal MBSYIMC is 
asserted (step S1). In response to this assertion of the 
MB synchronizing signal MBSYNC. a timer included in 
the control circuit 1226 (see Fig. 33) is started of count- 
ing (step S2). 

After the timer operation is started, a determination 
is made as to whether or not it is necessary to change a 
set time on the basis of the header information analyzed 
In the precedent processing section (step S3). When 
the processing method for the macro blocks Is compli- 
cated (in the case of B pictures subjected to bidirec- 
tional predictive encoding with motion prediction in 
fractional accuracy, for exanple). the processing unit 
time period is Increased, in this case, the set time is 
increased in accordance with the analyzed header Infor- 
mation. When a determination is made that the change 
of the set time Is necessary at the step S3, the time of 
the processing section is set at a proper value (long or 
short) in accordance with the analyzed header informa- 
tion. When a determination is made that the set time 
needs not be changed at the step S3, on the other hand, 
set time change processing at a step S4 is skipped. 
Then, a determination is made as to whether or not the 
count time of the timer reaches the set time (step S5). If 
the set time elapses, the process returns to the step S1 . 
so that the MB synchronizing signal MBSYNC indicating 
starting of the next processing section Is asserted. The 
step S5 is repetitively executed up to a lapse of the set 
time. 

The steps S3 and S4 may be carried out in parallel 
with the step SI . As to the change of the set time, if the 
timer is formed by a counter and a stored reference 
value of a register and the count of the counter Is com- 
pared by a comparator detecting matching/mismatching 
therebetween and the MB synchronizing signal 
MBSYNC is asserted in accordance with the result of 
comparison of the comparator, the reference value of 
the register is changed. When a counter of a variable 
stage number is employed and the stage number of the 
counter is changed upon changing of the set time, a 
count-up signal of the counter can be utilized as the MB 
synchronizing signal MBSYNC. 

When the time period of the processing section Is 
constant, the steps S3 and S4 are omitted. 

Fig. 9 illustrates another technique of setting the 
time period of the processing section. The control oper- 
ation shown in Fig. 9 is also executed in the control cir- 
cuit 1226 shown in Fig. 32. The structure of the control 
circuit 1226 is described later In detail. 

The processing section Is started and the MB syn- 
chronizing signal MBSYNC is asserted (step S10). 
Then, steps SI 2, S14 and SI 6 are executed in a paral- 
lel mode. At the step S12. a determination is made as to 



whether or not loading of the bit stream from the rate 
buffer into the variable length decoder is completed. At 
the step SI 4, a determination is made as to whether or 
not a prescribed set time elapses from the assertion of 
the MB synchronizing signal MBSYNC. At the step S1 6, 
a determination is made as to whether or not analysis of 
header information is entirely completed. A signal indi- 
cating whether or not the analysis of the header infor- 
mation is entirely completed is outputted from the 
variable length decoder, as described later in detail. The 
results of these determinations are monitored at a step 
S18, so that the process returns from the step S18 to 
the step SIO if all results of the determination at the 
steps S12, S14 and SIS are affirmative (YES), and the 
MB synchronizing signal MBSYNC designating starting 
of the next processing section is asserted. 

It is possible to reliably start the next processing 
section after necessary processing is completed by exe- 
cuting the processing operation shown in Fig. 9. It is 
possible to prevent the next section from being started 
in an intermediate stage of the data processing (during 
the data read operation from the rate buffer or the 
header analysis operation, for example). As compared 
with a structure of fixedly setting the time period of the 
processing section, therefore, the series of processing 
from the variable length decoding operation to the pixel 
restoration processing is reliably started In a pipeline 
mode after all necessary processing is completed (after 
all necessary data are supplied). Referring to Fig. 9, the 
set time at the step S1 4 may be rendered changeable in 
accordance with the attributes of the segments to be 
decoded (see Fig. 8). 

As hereinabove described, it is possible to remark- 
ably reduce the segment processing sections in time by 
bringing the respective operational processors of the 
picture decoding circuit into a pipeline structure in the 
units of the segments. 

Error Processino Operation: 

The data of the bit stream inputted In the picture 
decoding circuit may include error bits. In the bit stream 
subjected to variable length encoding, lengths of sym- 
bols are different from each other. When an error bit is 
mixed, therefore, an error of one symbol exerts an influ- 
ence on a following symbol and hence correct variable 
length decoding cannot be carried out. Due to the mixed 
error bit. the picture decoding circuit makes transition 
from a steady, normal state of carrying out correct 
decoding to an unsteady, abnormal state Incapable of 
carrying out correct decoding. The picture decoding cir- 
cuit must carry out return from such an abnormal state 
to the normal state and processing of suppressing qual- 
ity deterioration of decoded pictures in the abnormal 
state to the minimum. The processing which is carried 
out between error detection and return to the correct 
state is called error processing. Processing for reducing 
the influence by the error on the display screen which is 
carried out on the segments processed In the abnormal 
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state is called "error concealment processing". The 
error processing operation and the error concealment 
processing are now described. 

Fig. 10 is a flow chart schematically representing 
an operation of the picture decoding circuit upon error 
detection. The operation of the picture decoding circuit 
in en-or detection is now described with reference to Fig. 
10. 

Rrst, an error is detected at a step S20. In this error 
detection, a determination on occurrence of an error is 
made when a necessary symbol is not found in header 
analysis including a start code in the variable length 
decoder, or a corresponding symbol is not found in var- 
iable length decoding processing of the quantization 
index, for example, and an error detection signal is gen- 
erated based on the result of comparison. 

When the error is detected, a start code having a 
particular pattern is searched (step S21). In the MPEG 
standard, the start code includes a slice start code, a 
picture start code, a GOP start code or a sequence start 
code for indicating starting of a layer, or a sequence 
error code. 

When the start code is detected through the search 
process, a determination is made as to whether or not 
the detected start code is effective for connect return 
{step S22). For example, a sequence error code which 
is a start code is not effective for the correct return 
(return to the steady state). Therefore, search for 
another start code is continued. 

When a start code effective for correct return is 
detected, a header following this start code is analyzed 
{step S23). At this time, header Information Included In 
the first segment following the start code is analyzed. 
Through this header analysis, the segment which must 
return to the normal state (steady state) is identified. As 
shown in Fig. 11, a header 1400 (including all headers 
up to a macro block header preceding macro blocks of 
the segment) stores resynchronization segment 
address information 1402 indicating the position on the 
display screen of the segment (macro block) at which 
return is made to the normal state in error generation. In 
the MPEG standard, for example, the resynchronization 
segment address information 1402 con-esponds to a 
slice vertical position and macro block address Incre- 
ment included in the slice header. A resynchronization 
segment address is identified by analyzing the header 
1400, whereby the segment which should return from 
the unsteady state to the steady state can be identified. 

When the valid start code Is a sequence start code, 
a GOP start code or a picture start code in the MPEG 
standard, for example, the segment which should return 
to the steady state is the first segment of the picture. 

When the detected start code is a slice start code, 
return to the steady state can be started from the first 
segment of the slice layer since the slice layer is pro- 
vided for preventing error propagation. The header of 
the slice layer includes information indicating the posi- 
tion on the screen as described above, and the informa- 



tion indicating the position on the screen is utilized as 
the resynchronization address. 

After the header information is analyzed, variable 
length decoding processing of the data of the macro 

5 block following the header Is waited until prescribed 
conditions are established. 

Namely, a determination is made as to whether or 
not the segment to be subsequently processed in the 
picture decoding circuit corresponds to the macro block 

10 address obtained in the header analysis carried out at 
the step S23 (step S24). 

In the search for the start code, the bit stream which 
is supplied to the picture decoding circuit is employed 
for the start code search, and no decoding processing 

IS of macro block data included in the bit stream is carried 
out. On the other hand, the picture decoding circuit out- 
puts picture data subjected to the en"or concealment 
processing which is described later in detail every 
processing section. For example, it is possible to recog- 

20 nize the address (position on the screen) of the seg- 
ment processed in each processing section by counting 
the MB synchronizing signal MBSYNC defining each 
processing section in the control unit, for example. 
Therefore, it is possible to discriminate whether or not a 

25 segment to be processed in the next processing section 
corresponds to the macro block address obtained in the 
header analysis in the control unit. When the macro 
block address of the segment to be subsequently proc- 
essed matches with the macro block address obtained 

30 by the header analysis, return is made to the normal 
operation from the next processing section under con- 
trol by the control unit (step S25). 

Also in the return from the unsteady state to the 
steady state, the header information is analyzed in 

35 advance and the decoding processing of the block data 
is started in accordance with the MB synchronizing sig- 
nal MBSYNC, whereby no reduction of the utilization 
efficiency is brought in the respective operational proc- 
essors of the picture decoding circuit. 

40 In the error development, reading of the predictive 
picture data in each processing section may be stopped 
so that this period is utilized for data reading from the 
rate buffer. This is because the pixel data of the macro 
block can be replaced by average value data of pixel 

45 data of a macro block in a same common picture in error 
development, as described later in detail. Thus, it is pos- 
sible to search for the necessary start code at a high 
speed. 

Rg. 12 schematically illustrates the structure of a 
so part related to the processing operation of error detec- 
tion and the return in the picture decoding circuit. This 
figure shows only the variable length decoder 1212 and 
the control unit 1226. The variable length decoder and 
the control unit are denoted by the same reference 
55 numerals as those of the variable length decoder and 
the control unit shown in Fig. 32. This is for indicating 
that the functions of picture decoding processing itself 
are Identical between the Inventive cuid conventional 
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units, but the structures are different from the conven- 
tional components as described above. 

The control unit 1226 supplies a start signal ^ACJ 
for starting picture decoding processing and the MB 
synchronizing signal MBSYNC to the variable length s 
decoder 1212. The variable length decoder 1212 out- 
puts to the control unit 1226 an error detection signal 
(|>ER, a valid start code (start code effective for return to 
the normal operation) detection indication signal ^SD 
and a processing unit decoding completion indication io 
signal (|>CPL indicating that the information of the 
header of the segment is entirely analyzed. The opera- 
tion of the structure shown in Fig. 12 is now briefly 
described with reference to Fig. 13 which is an opera- 
tion sequence diagram thereof. is 

The control unit 1226 asserts the MB synchronizing 
signal MBSYNC onto the variable length decoder 1212. 
The variable length decoder li212 decodes the block 
data in synchronization with the assertion of the MB 
synchronizing signal MBSYNC, and outputs fixed length 20 
OCT coefficient data. After completion of the decoding 
of the block data. Information of the header of the next 
segment is analyzed. When analysis of the header 
information Is entirely completed, the variable length 
decoder 1212 asserts the processing unit decoding 25 
completion indication signal <|>CPL onto the control unit 
1 226. When the processing unit decoding completion 
indication signal ^CPL is asserted, the control unit 1 226 
asserts the MB synchronizing signal MBSYNC again 
onto the variable length decoder 1212 after prescribed 30 
conditions are satisfied. In response to this, decoding 
processing of the block data is executed. When an error 
Is detected in the decoding procedure, the variable 
length decoder 1212 asserts the error detection indica- 
tion signal (|)ER. In response to the assertion of the error 35 
detection indication signal <|>ER. the control unit 1226 
enters an error state. In this en-or state, error conceal- 
ment processing described later is executed. The varia- 
ble length decoder 1212 searches for a start code in 
response to the assertion of the error detection indica- 40 
tion signal (|»ER. When a valid start code Is detected, the 
variable length decoder 1212 asserts the start code 
detection Indication signal 4>SD. When the start code is 
detected, the variable length decoder 1212 analyzes 
the information of the header part of the segment follow- 4S 
ing the start code, and asserts the processing unit 
decoding completion indication signal ^CPL at the point 
of time when the analysis Is completed, onto the control 
unit 1226. The control unit 1226 determines whether or 
not the segment to be executed in the next processing so 
section Is that whose header information is analyzed in 
accordance with the analyzed header information and 
the start code information, and asserts the MB synchro- 
nizing signal MBSYNC in response to the assertion of 
the processing unit decoding conrpletion Indication sig- ss 
nal <|>CPL If the segment is to be executed in the next 
processing section. In the sequence shown in Rg. 13. 
therefore, the process returns to the steady state (nor- 



mal state) from the processing section following that 
causing the error. 

Rg. 14 illustrates another operation sequence of 
the picture decoding circuit in error detection. Referring 
to Fig. 14, an operation sequence identical to that 
shown in Rg. 13 is executed after the error detection 
indication signal ^ER is asserted In error detection until 
the processing unit decoding completion indication sig- 
nal (t)CPL is asserted. 

Upon assertion of the processing unit decoding 
completion indication signal (t>CPL, the control unit 1226 
determines a time when the segment of the analyzed 
header must be processed from the analyzed header 
Information (detection of the macro block address). 
When the analyzed segment is not to be executed in the 
next processing section, the control unit 1226 asserts 
the MB synchronizing signal MBSYNC on conditions of 
assertion of the processing unit decoding completion 
indication signal <|)CPL, a lapse of a prescribed time 
(see Rg. 9) from the precedent MB synchronizing signal 
MBSYNC and vacancy (nonuse) of the DRAM port. In 
the error time, the processing of the block data of the 
analyzed segment is brought into a standby state. Until 
the processing section for the segment which Is ana- 
lyzed and brought into the standby state is reached, the 
MB synchronizing signal MBSYNC is asserted every 
lapse of the prescribed time on the condition of vacancy 
of the DRAM port. The vacancy of the DRAM port is 
made one of conditions in the error state since it is nec- 
essary to write decoded data from the picture decoding 
circuit in the DRAM port. In this error state, the process- 
ing unit decoding completion Indication signal cjiCPL 
may be maintained in an asserted slate. Namely, the 
processing unit decoding completion indication signal 
(t>CPL may be reset by assertion of the MB synchroniz- 
ing signal MBSYNC when the block data are to be proc- 
essed in the next processing section. 

When the processing section for processing the 
segment in the standby state is reached, the picture, 
decoding circuit enters the normal state in accordance 
with assertion of the MB synchronizing signal MBSYNC, 
to decode the block data of the segment in the standby 
state. 

When a processing section for an actual decoding 
Is detected from the resynchronization segment 
address obtained at the time of the header analysis in 
the error state for return to the normal state, the follow- 
ing method can be employed: A counter which is reset 
in synchronization with a picture synchronizing signal 
(e.g., a vertical synchronizing signal VSYNC) indicating 
starting of a picture is employed to count the MB syn- 
chronizing signal MBSYNC, and the macro block 
address (position on the screen) of each processing 
section is monitored In accordance with the count value. 
When an address subsequent to the monitored macro 
block address is equal to the resynchronization 
address, the block data of the segment at the standby 
state must be processed in the next processing section. 
Since the header Information is entirely analyzed before 
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assertion of the MB synchronizing signal MBSYNC, this 
determination processing can be reliably carried out in a 
processing section which is precedent to that for actu- 
ally executing the decoding processing. 

Also in such error development, the header infor- 
mation is entirely analyzed and the subsequent 
processing is brought into a standby state and process- 
ing of the standby state block data is executed in syn- 
chronization with the MB synchronizing signal MBSYNC 
when the processing must be earned out. The block 
data to be processed are immediately supplied to the 
variable length decoder 1212 in synchronization with 
the MB synchronizing signal MBSYNC also in return 
from the error state to the normal state, and hence the 
processing can be executed at a high speed. In the 
operation sequence shown in Fig. 14. no block data are 
newly supplied to the picture decoding circuit during the 
period of the error state. The error concealment 
processing described later in detail is executed in this 
processing section. 

Rg. 15 specifically illustrates the internal structure 
of the variable length decoder 1212 shown in Rg. 12. 
Referring to Rg. 15. the variable length decoder 1212 
Includes a bit stream feeder 1 receiving the bit stream 
which is read from the rate buffer through a buffer mem- 
ory (not shown) and supplying bit stream data from the 
head (first) bit of a variable length symbol, a start code 
detector 2 receiving the data from the bit stream feeder 
1 and detecting the start code, a header analysis part 3 
receiving the bit stream data from the bit stream feeder 
1 and analyzing the header information, a block data 
decoder 4 decoding the block data Included in the bit 
stream data from the bit stream feeder 1 and generating 
fixed length quantized DCT coefficient data, an error 
detection part 5 detecting occurrence of an error in 
response to an error detection signal from the start code 
detection part 2, the header analysis part 3 and the 
block data decoder 4, and a control part 6 controlling the 
operation of the variable length decoder 1212. 

The control part 6 receives a start request signal 
(|)ACT (this signal is described later in relation to an 
operation in resetting) and the MB synchronizing signal 
MBSYNC, and outputs an error detection indication sig- 
nal <^ER, a processing unit decoding completion indica- 
tion signal ^CPL and a start code detection indication 
signal (j)SD. This control part 6 receives a detected start 
code from the start code detection part 2, and asserts 
the start code detection indication signal ^SO when the 
start code Is effective for return to the steady stata The 
control part 6 also receives a header information analy- 
sis completion indication signal (detected by end bit 
detection of the header) from the header analysis part 3 
and asserts the processing unit decoding completion 
indication signal (|)CPL The control part 6 asserts the 
error detection indication signal 4»ER in response to the 
error detection signal from the error detection part 5. 

The control part 6 further receives the start code 
from the start code detection part 2. information indicat- 
ing a bit lengths of analyzed variable length code from 



the header analysis part 3, and bit length information of 
a decoded variable length code from the block data 
decoder 4, deletes the processed (detected, analyzed 
or decoded) variable length code in the bit stream 

5 feeder 1 , detects a next head bit of a variable length 
code and supplies the next variable length code from 
the head (first) bit to the header analysis part 3 or the 
block data decoder 4 from the feeder 1. The bit stream 
feeder 1 regularly outputs data bits successively from 

w the most significant bit of a variable length code under 
the control of control part 6. The start code detector 2 
constantly monitors the bit data from the bit stream 
feeder 1, to detect whether or not the start code is 
included. 

IS The header analysis part 3 analyzes variable length 
code words (header information) supplied from the bit 
stream feeder 1 immediately subsequently to the com- 
pletion of the decoding operation of the block data 
decoder 4 under control by the control part 6 (this con- 

20 trol path is not shown) . The block data decoder 4 is acti- 
vated in synchronization with the MB synchronizing 
signal MBSYNC under control by the control part 6, and 
decodes the variable length codes supplied from the bit 
stream feeder 1 . 

25 The header analysis part 3 extracts information 
such as motion vectors, a processing method (predic- 
tion method) for the macro blocks and the like as well as 
return (resynchronization) segment address information 
In error generation for supplying to the control unit The 

30 block data decoder 4 outputs a fixed length quantization 
index to the next stage inverse quantizer. 

TTie header analysis part 3 is described as con- 
stantly analyzing variable length codes. However, the 
sequence header, the GOP header and the picture 

35 header are fixed length data, which are subjected to 
fixed length decoding. Whether the header analysis part 
3 carries out analysis of fixed length codes or analysis 
of variable length codes is decided by the control part 6 
in accordance with the start code detected in the start 

40 code detection part 2. The control part 6 instructs the 
header analysis part 3 about which analysis operation 
should be carried out in accordance with the detected 
start code. Alternatively, such a structure that the 
header analysis part 3 Itself deternnines which operation 

45 is carried out along a syntax may be employed. Further, 
the start code detection part 2 is described as con- 
stantly searching for the start code. However, the start 
code detector 2 may alternatively be so structured that 
its detecting operation is stopped in operations of the 

so header analysis part 3 and the block data decoder 4. 

Rg. 16 specifically illustrates the internal structure 
of the control unit 1226 shown in Fig. 12. Referring to 
Rg. 16, the control unit 1226 includes an initialization 
control circuit 14 outputting a start indication signal 

55 (t>ACT for the variable length decoder in response to a 
reset request indication signal <|»RRQ. a state monitor 15 
monitoring the progress state of the processing of the 
variable length decoder in accordance with the error 
detection indication signal ^BR and the start code 
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detection Indication signal ^SD from tiie variable length 
decoder, and an operation driving circuit 1 1 receiving 
the starting Indication signal (|)ACT from the Initialization 
control circuit 14, the output signal from the state moni- 
tor 15. a picture synchronizing signal PSYNC Indicating 
starting of a picture, a processing unit decoding comple- 
tion indication signal (|>CPL supplied from the variable 
length decoder and header information (block specify- 
ing information) and supplying the MB synchronizing 
signal MBSYNC to respective pipeline stages of com- 
puting units of the decoding circuit. 

The initialization control circuit 14 asserts the start- 
ing indication signal (|>ACT for supplying to the variable 
length decoder when the reset r^uest signal (t>RRQ 
requesting resetting of a decoding operation of picture 
data is asserted. This reset request signal <|>RRQ may 
be a decoding processing start indication signal for 
instructing the starting of decoding the picture data, or a 
reset request indication signal resulting from interrup- 
tion of an external control unit Further, the reset 
request signal ^RRQ may be generated when an error 
state is caused in continuation for a prescribed time 
duration or the error detection indication signal is suc- 
cessively asserted by a prescribed number of times in a 
prescribed time. 

The state monitor 15 informs the operation driving 
circuit 1 1 of the fact that an error occurs In the decoding 
process of the variable length decoder in response to 
assertion of the error detection indication signal <|)ER, 
and of the fact that the varisible length decoder enters a 
preparation stage for return to the normal state upon 
assertion of the start code detection indication signal 
(t»SD. 

The operation driving circuit 1 1 starts clocking of a 
timer 16 upon assertion of the MB synchronizing signal 
MBSYNC. The timer 16 carries out its counting opera- 
tion, and supplies a time-out signal to the operation driv- 
ing circuit 11 upon reaching a set time. This timer 16 
may be so structured that the operation driving circuK 1 1 
changes the set time in accordance with block attribute 
information (header information) supplied from the vari- 
able length decoder (see Fig. 8). In a normal state, the 
operation driving circuit 11 asserts the MB synchroniz- 
ing signal MBSYNC when the processing unit decoding 
completion indication signal ^CPL is asserted, the time- 
out signal from the timer 16 is asserted and a signal 
Indicating a vacant state (reading from the rate buffer is 
completed) of a DRAM port is received from a bus 
access controller 12. 

Upon error generation, the operation driving circuit 
11 carries out the following operation in accordance 
with a signal outputted from the state monitor 15: The 
operation driving circuit 11 includes a counter (not 
shown) which is reset in response to the picture syn- 
chronizing signal PSNC and counts up every assertion 
of the MB synchronizing signal MBSYNC. The count 
value of this counter indicates the position on the saeen 
(macro block address) of the segment processed In the 
variable length decoder When it is informed from the 
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state monitor 1 5 of the fact that a start code effective for 
normal return is detected in accordance with the start 
code detection indication signal ^SD, the operation driv- 
ing circuit 1 1 extracts a resynchronization address from 

5 the block attribute information which is supplied follow- 
ing the start code detection Indication signal ^SD, It 
compares the resynchronization address with the count 
value of the counter, and determines whether or not it is 
possible to return to the normal state from the next 

10 processing section. If it is possible to return to the nor- 
mal state at the next processing section, the operation 
driving circuit 1 1 asserts the MB synchronizing signal 
MBSYNC in response to assertion of the processing 
unit decoding completion indication signal ^CPL which 

IS is supplied following the start code detection indication 
signal <|>SD. time out indication of the timer 1 6 and a rate 
buffer reading completion (DRAM port empty) Indication 
signal from the bus access controller 12. The respective 
operational processors following the variable length 

20 decoder (block data decoder of Fig. 15) operate in 
response to the MB synchronizing signal MBSYNC. 

When the next processing section Is not yet that In 
which return to the normal state should be made, on the 
other hand, the operation driving circuit 1 1 outputs the 

2S MB synchronizing signal MBSYNC in accordance with 
the time-out signal outputted from tiie timer 16 and the 
signal of the bus access controller 12 indicating nonuse 
of the DRAM port. In this error state (the state where the 
next processing section is not that in which return to the 

30 normal state should be made), the MB synchronizing 
signal MBSYNC may be supplied to the pipeline stages 
of the respective operational processors excluding the 
variable length decoder. Alternatively, the MB synchro- 
nizing signal MBSYNC may be supplied to the respec- 

35 tive operational processors of the pipeline stages 
including the variable length decoder (block data 
decoder) while a normal return inhibition signal is 
asserted from the operation driving circuit 1 1 to be sup- 
plied to the variable length decoder simultaneously at 

40 this time so that a variable length decoding operation by 
the variable length decoder can be inhibited. Also in the 
error state, the picture decoding drcuit outputs picture 
data (the error concealment processing described later 
Is carried out). 

4S When a segment in a standby state is to be exe- 
cuted in the next processing section, the operation driv- 
ing circuit 11 asserts the MB synchronizing signal 
MBSYNC in accordance with the time-out signal output- 
ted from the timer 16 and the signal indicating the empty 

so state of the DRAM port outputted by the bus access 
controller 12. Thus, the operation driving circuit 11 
returns to the normal state, and stops the operation of 
comparing the count value of the counter with the resyn- 
chronization segment address. In this normal state, the 

55 operational processors following the \mriable length 
decoder (block data decoder) operate in accordance 
with the MB synchronizing signal MBSYNC from the 
operation driving circuit 11. to execute prescribed nor- 
mal processing respectively 
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The bus access controller 12 controls an access 
operation to the DRAM port under control by the opera- 
tion driving circuit 1 1 . Namely, it executes port control of 
the FIFO interface 1210 and the memory interlace 1224 
shown in Fig. 32 successively in a prescribed order. 
Namely, the bus access controller 12 first writes com- 
pletely decoded picture data from the pixel recorrflgura- 
tor 1220 in the external memory (DRAM) 1230 through 
the memory interface 1224 in synchronization with the 
MB synchronizing signal MBSYNC from the operation 
driving circuit 11 (in a normal operation). 

After completion of this write operation, the bus 
access controller 12 executes writing of the bit stream 
from the FIFO interface 1210 in the external memory 
(DRAM) through the memory interface 1224 (writing in 
the rate buffer), reading of display picture data from the 
external memory (DRAM) 1 230 in the pixel bus interface 
1222 through the memory interface 1224, transfer of 
predictive picture data from the external memory 
(DRAM) 1230 through the memory interface 1224, and 
transfer of data from the external memory (DRAM) 1230 
into the variable length decoder through the FIFO inter- 
face 1210 and the memory interface 1224 (transfer to a 
buffer memory {not shown)) (reading of the rate buffer). 
During this time, the bus access controller 12 executes 
refreshing of the external memory (DRAM) 1230 at pre- 
scribed intervals, and inhibits access to the external 
memory during this refreshing. In the error state, the 
bus access controller 12 may utilize the period of read- 
ing predictive picture data as a period of reading data 
from the rate buffer in response to the error state indica- 
tion signal from the operation driving circuit 11. Further, 
a completion time of reading the predictive picture data 
may be decided in accordance with the block attribute 
information from the operation driving circuit 1 1 . 

An error concealment control circuit 1 3 controls the 
error concealment processing described later in detail. 
This en'or concealment control circuit 13 is started in 
response to the error detection indication signal <|»ER 
from the state monitor 15 to instruct the error conceal- 
ment processing (signal (t)ERR) to the scan conversion 
part or to the pixel reconf igurator and the scan conver- 
sion part, and instructs completion of this error conceal- 
ment processing in response to a normal state return 
indication from the operation driving circuit 1 1 . 

According to the embodiment of the present inven- 
tion, as hereinabove described, the start code which is 
effective for return from the error state to the steady 
(normaO state is detected in error generation, then anal- 
ysis of the header information of the segment is exe- 
cuted and processing of the block data of the segment 
is delayed up to arrival of the processing section for 
actual processing, whereby return to the normal state 
can be carried out also in error development without 
reducing the utilization efficiency of the operational 
processors. 



Frrnr Concealment P rocessing 1: 

Rg. 17 schematically illustrates the structure of the 
pixel reconf igurator 1220 of the picture decoding circuit 
5 according to the present invention. Referring to Fig. 1 7. 
the pixel reconf igurator 1220 includes a buffer memory 
20 tenrporarily storing data supplied through the mem- 
ory interface 1224, a predictive picture filter part 21 
forming predictive pictures through the picture data 
10 stored in the buffer menrwry 20. a computing element 22 
illustrated as an adder for adding up data from the 
inverse discrete cosine transformation part (IDCT) 1218 
and an output signal from the predictive picture filter 
part 21 and carrying out DPCM decoding, a selection 
IS circuit 23 selecting one of the data oulputted from the 
IDCT 121 8, data outputted from the computing element 
22 and the pixel data from the predictive picture filter 
part 21 , and a buffer memory 24 temporarily storing out- 
put data of the selection circuit 23. The storage data of 
20 the buffer memory 24 are stored in the external memory 
(DRAM) as decoded pixel data through the memory 
interface 1224. Macro block types of B pictures include 
(1) intra-frame/intra-field prediction employing neither 
one of fonward prediction and reverse (backward) pre- 
25 diction, (2) forward prediction in which prediction is 
made based on past reproduced pictures, (3) reverse 
prediction in which prediction is made based on the 
future pictures, and (4) interpolation prediction employ- 
ing both of past and future pictures. 
30 The predictive picture filter part 21 carries out pre- 
scribed processing in accordance with the macro block 
type, and forms predictive pictures. The pixel reconfigu- 
rator 1220 further includes a control part 25 for control- 
ling the operation of pixel reconfiguration. The control 
35 part 25 receives header information supplied from the 
variable length decoding part, the MB synchronizing 
signal MBSYNC and the error detection indication sig- 
nal (t)ERR from the control unit (see Rg. 16), and a bus 
employment allowing signal from the control unit (bus 
40 access controller). The control part 25 decides filter 
processing which is executed in the predictive picture fil- 
ter part 21 in accordance with the macro block type 
included in the header information. Further, the control 
part 25 controls data writing and data reading in and 
4s from the buffer memories 20 and 24 in synchronization 
with the MB synchronizing signal MBSYNC. 

As to picture data which are loaded in the buffer 
memory 20 through the memory interface 1224. 
addresses are generated in accordance with motion 
so vector information formed through the result of analysis 
of the header analysis part in the variable length 
decoder and necessary picture data (reference seg- 
ment data) is read from the external memory (DRAM). 
In error development, the motion vector information is 
55 formed on the basis of transmitted motion vector infor- 
mation. As described later, this motion vector may be 
set at zero in the case of an error generation. Alterna- 
tively, motion vector indicating a macro block which Is 
precedent by one line may be employed in the case of 
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an error generation. Namely, macro block data of a cor- 
responding portion in the predictive picture(s) are read 
in error generation. 

Under control by the control part 25, the selection 
circuit 23 selects the data from the IDCT 1 21 8 when the s 
processed macro block Is an intra-predicted macro 
block (I pictures and intra-predicted B pictures), selects 
the data outputted from the computing element 22 with 
respect to a prediction encoded macro block other than 
intra prediction, and selects the output data from the 
predictive picture filter part 21 in error processing. An 
error countermeasure operation in the case of employ- 
ing the pixel reconfigurator shown in Rg. 17 is now 
described. 

Fig. 18 is an operation sequence diagram repre- 
senting the error countermeasure operation of the pic- 
ture decoding circuit in error processing. As shown in 
Fig. 18, the picture decoding circuit is formed into four 
pipeline stages in units of segments (macro blocks), 
similarly to the aforementioned embodiment. Consider 
that an error occurs in a decoding process for block data 
of a segment MB#1 1 . The enror detection indication sig- 
nal <|)ER ((t)ERR) is asserted in this state, while the vari- 
able length decoder and the control unit execute the 
aforementioned operations upon generation of an error 
In the processing section during which this error occurs, 
the pixel reconfigurator 1220 shown In Fig. 17 carries 
out a pixel decoding operation so that restored pixel 
data are stored in the buffer memory 24. When a next 
processing section is started, predictive picture data for 
error concealment of a part corresponding to a macro 
block MB#12 are stored in the buffer memory 22 
through the memory internee 1224. The predictive pic- 
ture filter part 21 forms predictive picture data for the 
macro block MB#1 1 . On the other hand, the IDCT 1 218 
forms inverse-quantized data of block data of a macro 
block MB#10, so that pixel -restored data are formed in 
accordance with the macro block type thereof through 
the selection circuit 23 and successively written in the 
buffer memory 24. In the buffer memory 24, on the other 
hand, previously stored decoded pixel data of a macro 
block MB#9 are written in the DRAM through the mem- 
ory interface 1224. In the buffer memories 20 and 24. 
new data are written after storage data thereof are 
entirely read out. 

Thereafter pipeline processing Is successively exe- 
cuted so that data of corresponding macro blocks of the 
predictive pictures are successively read from the exter- 
nal memory (DRAM) and picture data are generated In 
this error state (slanted areas in Fig. 18). 

Predictive picture pixel data read in the processing 
section for the macro block MB#12 are selected by the 
selection circuit 23. Thus, corresponding pixel data of 
the predictive pictures are successively stored In the 
buffer memory 24. The predictive picture fflter part 21 
carries out filter processir>g in accordance with a prede- 
termined rule in error detection. 

Therefore, pixel data subjected to error counter- 
measures, i.e., pixel data of predictive pictures, are suc- 



cessively stored in the DRAM from a processing section 
for processing a macro block MB#15. 

When the error state is ended in a processing sec- 
tion for a macro block MB#16, processing of a macro 
block MB#1 7 Is executed from the next processing sec- 
tion. In this case, the selector 23 selects either data out- 
putted from the IDCT 1218 or data outputted from the 
computing element 22 in accordance with header Infor- 
mation when the processing of the block data of the 
macro block MB#17 reaches the third pipeline stage. 

Due to the aforementioned series of operations, 
pixel data which are missed by an error can be replaced 
by pixel data of predictive pictures in an error state, 
thereby suppressing picture quality deterioration of 
decoded picture images caused by mixing of an error bit 
(see Fig. 19). Namely it is possible to suppress deterio- 
ration in quality of decoded Images in the macro blocks 
MB#12 to MB#16 in the en-or state, as shown in Fig. 19. 

Error Concealment Processino 2: 

Rg. 20 Illustrates the structure of a pixel reconfigu- 
rator 1220 for implementing second error concealment 
processing according to the present Invention. In the 
structure of the pixel reconfigurator shown in Fig. 20, a 
control part 35 sets a selection circuit 33 in a state 
selecting an output signal of an IDCT 1218 in response 
to header information, an MB synchronizing signal 
MBSYNC, an output signal of a bus access controller 
and an error concealment control circuit included in the 
control unit of Fig. 6 when an error is generated. Other 
structures are identical to those shown in Fig. 17, and 
corresponding parts are denoted by the same reference 
numerals. In a normal state, the control part 35 makes a 
computing element 22 process (DPCM-decode) pixel 
data from a predictive picture filter part 21 and pixel data 
outputted from the IDCT 1 21 8, and thereafter selects an 
output signal from the IDCT 1218 or the computing ele- 
ment 22 through the selector 33 in accordance with the 
type of this picture for writing into a buffer memory 24. In 
an error state, i.e., in activation of a signal (|)ERR, the 
control part 35 controls the selection circuit 33 and sets 
the same in a state selecting the data outputted from the 
IDCT 1218 regardless of the picture type. 

The IDCT 1 21 8 is supplied with data outputted from 
a scan conversion part 1216 whose structure is hereaf- 
ter described In detail. As hereafter described in detail, 
in an error state, the scan conversion part 1216 supplies 
the IDCT 1218 with decoded macro block data prece- 
dent by one line (data before IDCT processing) in the 
same picture or a predetermined fixed value (when no 
macro block precedent by one line is present) from a 
processing section following that having the error 
caused. 

Fig. 21 Illustrates the internal structure of the scan 
conversion part 1216 shown in Fig. 20 in detail. Refer- 
ring to Fig. 21, the scan conversion part 1216 includes 
a buffer memory 40 successively storing inverse-quan- 
tized DCT coefficient data outputted from an inverse 



15 



20 



25 



30 



35 



40 



45 



50 



19 



37 



EP 0 731 422 A2 



38 



quantizer and then outputting the stored data in the 
raster scan order, a read/write control circuit 41 control- 
ling data writing and data reading of the buffer memory 
40, an averaging circuit 42 obtaining the average value 
of DCT coefficients read from the buffer memory 40, a 5 
memory 43 storing average data of macro blocks by one 
line» for example, among average value data oulputted 
from the averaging circuit 42 in a FIFO fashion, a 
read/write control circuit 44 controlling data writing and 
reading of the memory 43. and a selection circuit 45 to 
selecting either DCT coefficient data outputted from the 
buffer memory 40 or data from the memory 43 for out- 
putting to the IDCT 1218 under control by the read/write 
control circuit 44. 

The read/write control circuit 41 stores In buffer is 
memory 41 inverse quantized DCT coefficient data 
which are supplied from the inverse quantizer at the 
precedent stage in synchronization with the MB syn- 
chronizing signal MBSYNC. This read/write control cir- 
cuit 41 simply has a function of converting read and 20 
write addresses for the buffer memory 40, and adjusts 
the addresses to re-arrange the DCT coefficients, which 
have been scanned in a zigzag scan fashion, into the 
raster scan order for outputting. The address generation 
may be so done that either read or write addresses are 25 
generated in a predetermined sequence while the other 
addresses are successively incremented so that zig- 
zag-scanned pixel data are re-arranged in the raster 
scan order. The zigzag scan converter 1216 may not be 
particularly included in a pipeline stage, since it func- 30 
tions as a buffer circuit by the buffer memory 40. There- 
fore, the readAAfrite control circuit 41 may be formed to 
generate addresses in synchronization with an input 
synchronizing signal indicating starting of the DCT coef- 
ficient data. 35 

The averaging circuit 42 obtains the average value 
of the DCT coefficient data which are read from the 
buffer memory 40. At this time, the average value may 
be obtained by arithmetic mean values (all DC and AC 
coefficients) of all DCT coefficient data. In a block of 8 4o 
by 8 pixels, however, a DC coefficient indicates the aver- 
age value of pixel data of the block. Therefore, the aver- 
aging circuit 42 may obtain the average value of the 
DCT coefficient data of four blocks for a luminance sig- 
nal while utilizing the DC coefficient as the average 4S 
value for a chrominance signal, with respect to one 
macro block. 

The memory 43 stores average value data of DCT 
coefficients with respect to respective macro blocks for 
one line, for example. In the FIFO fashion. Operations of so 
the scan conversion part and the pixel reconfigurator 
shown in Figs. 20 and 21 are now described with refer- 
ence to Fig. 22, which is an operation sequence dia- 
gram. 

Fig. 22 illustrates operations in the case where an ss 
error is caused in decoding of block data of a macro 
block MB#1 1 and return is made to a normal state from 
a macro block MB#17. for example. 



When an error detection indication signal 4>ER is 
asserted, an error indication signal (|)ERR from the error 
concealment control circuit is asserted in response (no 
i|)ERR is shown in Fig. 22). In response to the assertion 
of the error detection indication signal <|)ERR, the 
read/write control circuit 44 shown in Fig. 21 inhibits 
writing of average value data to the memory 43. 
Namely, storage of an average value data of DCT coef- 
ficient data calculated is inhibited In the case of error 
detection. Therefore, the memory 43 stores the average 
value of DCT coefficients of one-line worthy macro 
blocks up to a macro block MB#9. No average value 
data of DCT coefficients of a macro block MB#10 is 
stored in the memory 43. Average value data of DCT 
coefficients of a macro block which is precedent to the 
macro block MB#10 just by one line is stored in a head 
address position of the mennory 43. In a processing sec- 
tion having this error caused, pixel restoration process- 
ing for the macro block MB#9 is executed. Namely, the 
selection circuit 33 shown in Fig. 20 selects either an 
output signal of the computing element 22 or data out- 
putted from the IDCT 1218 and supplies the selected 
one to the buffer memory 24. in accordance with an out- 
put signal from the confrol part 35. 

In a processing section subsequent to that having 
the error caused, the read/write control circuit 44 shown 
in Fig. 21 reads average value data of DCT coefficients 
of a macro block, which is precedent by one line, stored 
in the head position from the memory 43 in response to 
the error indication signal <t)ERR, and supplies the read 
average data to the IDCT 1 218 through the selection cir- 
cuit 45. The memory 43 may store one average value 
data for luminance blocks of the macro blocK or aver- 
age value data for respective luminance signal blocks 
(since the IDCT 1218 executes inverse discrete cosine 
fransformation processing in units of 8 by 8 pixels). 

The selection circuit 33 shown in Fig. 20 is set in a 
state of selecting data outputted from the IDCT 1218, 
under control by the confrol part 35. In the processing 
section sutisequent to that having the error caused, 
therefore, pixel restoration (DPCM decoding) is exe- 
cuted in accordance with the pixel data of the macro 
block which is precedent by one line. As shown in Fig. 
22, therefore, the error concealment processing can be 
executed from the macro block which is ahead of that 
having the error caused while the error concealment 
processing can be executed also for the macro block 
causing the error, whereby picture quality deterioration 
caused by mixture of an error bit can be further sup- 
pressed. Data of different macro blocks are succes- 
sively read from the memory 43 every processing 
section in synchronization with the MB synchronizing 
signal MBSYNC. 

When return is made from the error state to the nor- 
mal state, the data from the memory 43 are selected 
and supplied to the IDCT 1 21 8 in the processing section 
if the en'or indication signal (t)ERR is deasserted, aver- 
age value data from the averaging circuit 42 are written 
in the memory 43 in the next processing section, and 
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the selection circuit 45 is set in a state cf selecting the 
output of the buffer memory 40 in a processing section 
subsequent to the next one. 

The memory 43 stores the data in the FIFO fashion, 
and hence the state of successively storing the pixel s 
block data for one line is maintained also when the aver- 
age value of block data of the macro block MB#17 is 
newly written in the memory 43 in the FIFO fashion. 

In the return to the normal state, data may be writ- 
ten in the buffer memory 40 in synchronization with an io 
input synchronizing signal indicating starting of block 
data supplied from the precedent stage inverse quan- 
tizer under control by the read/write control circuit 41 . 
Alternatively, a normal state return indication signal may 
be supplied to the read/write control circuit 41 from the 75 
control unit so that the writing is performed from the 
processing section supplied with the normal state return 
indication signal (when the scan conversion part forms 
the final substages of the first pipeline stage including 
multiple substages (the first pipeline stage is up to data 20 
writing in the buffer 40)). Alternatively, the data may be 
written in the buffer memory 40 under control by the 
read/write control circuit 41 from a processing section 
subsequent to the processing section of return to the 
normal state (when the scan conversion part Is included 25 
in the third pipeline stage). Alternatively, the scan con- 
version part 1216 may be arranged to form a part of the 
second pipeline stage. 

When the error Is caused at the head of the picture, 
a predetermined fixed value Is employed since no corre- 30 
spending average value data Is present. While this 
structure is not shown, either average value data or 
fixed value data may be selected in accordance with 
address (position on the screen) information of the proc- 
essed macro block, as shown in the dotted line in Fig. 3S 
21. 

Fig. 23 illustrates modes of the macro blocks which 
are subject to en-or-concealment process In the second 
error concealment processing shown in Figs. 20 to 22. 
As shown In Rg. 23, the error concealment processing 40 
is executed through pixel data of a macro block which is 
ahead of the macro block MB#10, precedent to the 
macro block MB#1 1 having the error caused, by one 
line. Namely, the block data of the macro blocks MB#10 
to MB#16 are replaced by pixel data of macro blocks 45 
MB#2 to MB#8 which are precedent by a single line in 
the same picture. 

In the above description, the error concealment 
processing is carried out through the average value of 
the block data of the precedent macro blocks in error so 
development. A line memory storing pixel data of macro 
blocks for one line may be arranged in the pixel recon- 
figurator 1220 so that decoded pixel data of the macro 
blocks stored in this line memory are stored in the exter- 
nal memory (DRAM) through the buffer memory 24 for ss 
replacing the respective pixel data with those of the 
macro block precedent by one line respectively in error 
development. 



According to the structure of the emkxxJiment of the 
present invention, as hereinabove described, the error 
concealment processing can be efficiently executed by 
effectively utilizing the pipeline stages of the picture 
decoding circuit. Particularly when the error conceal- 
ment processing is carried out through decoded data 
(variable length decoded data) in the same picture, the 
error concealment processing can be executed from the 
macro block which is precedent in processing order to 
the segment (macro block) having the detected error, 
whereby further effective error concealment processing 
can be carried out and picture quality deterioration 
caused by mixing of an error bit can be suppressed. 

Initialization Operation 1 : Restartino meturn from Error) 

Rg. 24 is a flow chart showing an initialization oper- 
ation of the picture decoding circuit. The initialization 
operation of the picture decoding circuit according to the 
present invention Is now described. 

First, a determination Is made as to whether or not 
a reset request is made (step S30). This reset request is 
made in restarting when break of display by Interruption 
through an external control unit or an error state contin- 
ues over a prescribed time (when a state of returning 
from an error state to the normal state followed by re- 
return to the error state is continued). 

When a reset request (restart instruction) is made, 
the control unit 1226 (see Fig. 16) first determines 
whether or not this picture decoding circuit currently car- 
ries out decoding of picture data (step S31). If decoding 
of the picture data is currently carrl^ out (when a pixel 
restoration operation Is carried out: including an opera- 
tion In an error state), generation of the MB synchroniz- 
ing signal MBSYNC from the next processing section Is 
stopped (step S32). When generation of the MB syn- 
chronizing signal MBSYNC Is stopped, the start signal 
<|)ACT (R) is asserted and supplied to the variable length 
decoder (see Fig. 1 5). When no pixel restoration opera- 
tion is carried out at the step S3 1 . on the other hand, the 
step S32 is skipped and the start signal ^ACJ (R) Is 
asserted at a step S33. 

The variable length decoder searches for a start 
code indicating starting of a picture in response to the 
assertion of the start signal ^ACT (R). Namely, it 
searches for a sequence start code, a GOP start code 
or a picture start code. At this time, a slice start code Is 
neglected because a new picture is searched. When a 
start code indicating starting of a picture Is detected, 
information of a header part following this start code Is 
analyzed, and header information of a segment of a 
macro block layer is analyzed (step S34). Establishment 
of prescribed conditions Is waited In the state of having 
analyzed the header information (step S35). The pre- 
scribed conditions are that a sufficient quantity of bit 
stream Is stored in the rate buffer and a vertical synchro- 
nizing signal supplied from the external display control 
unit is asserted. It is possible to discriminate whether or 
not a sufficient quantity of bit stream is stored in the rate 
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buffer by detecting difference between write and read 
addresses of FIFO area of the external memory device 
(DRAM) through the bus access controller 12 shown in 
Fig. 16. 

When the prescribed conditions are established, 
the control unit asserts a picture synchronizing signal 
indicating the starting of the picture, resets a counter 
included in its interior for indicating a macro block 
address, asserts the MB synchronizing signal in syn- 
chronization with the picture synchronizing signal, and 
makes the picture decoding circuit execute a normal 
operation (step S36). Due to the assertion of the MB 
synchronizing signal MBSYNC in synchronization with 
the picture synchronizing signal PSYNC, display picture 
data can be correctly read in synchronization with a ver- 
tical synchronizing signal, for example, supplied from 
the external control unit when the reset request is made 
and a new picture Is displayed. Further, pixel decoding 
operations can be successively executed in parallel with 
the picture display. 

The series of operations through the steps S30 to 
S33 are executed by the initialization control circuit 14 
shown in Fig. 16. 

Initialization Operation 2: Reset Operation 

Fig. 25 is a flow chart showing another initialization 
operation of the picture decoding circuit. This initializa- 
tion operation of the picture decoding circuit according 
to the present invention is now described. In this initiali- 
zation operation, the user newly designates picture dis- 
play. 

First, a determination is made as to whether or not 
a reset request (initialization insti^uctlon) is made (step 
S40). This reset request is generated from hardware or 
software (set of register values) in accordance with a 
picture display designation from the user. 

When the reset request is made to designate dis- 
play of a new picture, a start signal <|>ACT (I) is asserted 
and supplied to the variable length decoder (see Fig. 
15) since the picture decoding circuit carries out no pic- 
ture data decoding operation at this time (step 841). 

In response to the assertion of the start signal 
(|)ACT (I), the variable length decoder searches for a 
sequence start code. A GOP start code, a picture start 
code and a slice start code are neglected. When a 
sequence start code is detected and a start code indi- 
cating starting of a picture is then detected, Information 
of a header part following the start code is analyzed and 
header information of a segment of a macro block layer 
is analyzed (step S42). In the state of having analyzed 
this header information, establishment of prescribed 
conditions is waited (step S43). The prescribed condi- 
tions are identical to those described with reference to 
the step S35 in Fig. 24. Namely, the prescribed condi- 
tions are that a sufficient quantity of bit stream is stored 
in the rate buffer and a vertical synchronizing signal 
supplied from the external display control unit is 
asserted- When the prescribed conditions are estab- 



lished, the control unit asserts a picture synchronizing 
signal indicating starting of a picture, resets a counter 
indicating a macro block address included in its interior, 
asserts an MB synchronizing signal in synchronization 
5 with the picture synchronizing signal and makes the pic- 
ture decoding circuit carry out a normal operation (step 
S44). Upon user's reset request, the assertion of the 
MB synchronizing signal is made in synchronization 
with tiie assertion of the picture synchronizing signal, 
w whereby display picture data can be correctly read in 
synchronization with the vertical synchronizing signal, 
for example, supplied from the external control unit in 
the case of displaying a picture of a new sequence, and 
pixel decoding operations can be successively executed 
75 along the picture display. 

Tbe series of processing operations are executed 
by the initialization control circuit 14 shown in Fig. 16. 
The start signal <t)ACT is so indicated tiiat the same sig- 
nal is asserted in a reset request designating restarting 
20 of display and in tiiat designating initialization of display. 
However, these are different signals, and start codes to 
be searched in restarting and initialization are discrimi- 
nated in response to the types of the start signals 4»ACT, 
or <t>ACT (R) and (|jACT (I). 
25 Rg. 26 illustrates exemplary operations of the pic- 
ture decoding circuit in a reset operation. This figure 
shows such a state that an initialization indication (reset 
indication) instructing picture display is supplied from 
the exterior, for example (see Fig. 25). In this state, no 
30 MB synchronization signal MBSYNC is asserted since 
the picture decoding circuit canries out no pixel decod- 
ing operation. 

When a reset request signal 4»RRQ is asserted, the 
start signal <|)ACT (I) is outputled (asserted) from the ini- 
35 tialization control circuit shown in Fig. 1 6. In response to 
the assertion of the start signal ^ACT (I), the variable 
lengtii decoder searches for a start code indicating 
starting of a picture of a sequence layer. In this search 
operation, data are read from the rate buffer under con- 
40 trol by the control unit. If no bit stream is yet stored in the 
rate buffer but the bit stream first arrives upon genera- 
tion of the reset request signal <|>RRQ. tine control unit 
directiy supplies the bit stream supplied through the 
FIFO interface to the variable length decoder, to make 
45 tiie same search a start code. The variable length 
decoder analyzes the start code detected by tiie start 
code detector (see Fig. 15) in the control part 6, detects 
ttie picture start code indicating the starting of the pic- 
ture subsequently to the detection of the sequence start 
50 code, and analyzes header information subsequent to 
the detected picture start code. In restarting, a start 
code in a layer above a macro block layer is searched 
and header information is analyzed after detection 
tiiereof. When the header information of the segment .of 
55 the macro block layer is completely analyzed, the varia- 
ble length decoder asserts a processing unit decoding 
completion indication signal ifrCPL In response to the 
assertion of the processing unit decoding completion 
indication signal <|)CPL. the control unit waits for estab- 
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lishment of prescribed conditions. When the prescribed 
conditions are established. I.e.. when a sufficient quan- 
tity of bit stream is stored in the rate buffer and a vertical 
synchronizing signal is supplied, the control unit asserts 
the picture synchronizing signal PSYNC in its interior, 5 
while asserting the MB synchronizing signal MBSYNC 
In synchronization with this picture synchronizing signal 
PSYNC. In a first processing section, decoding of block 
data of the segment whose header information has 
been analyzed and analysis of header information fol- 10 
lowing this segment are executed. Thereafter the MB 
synchronizing signal MBSYNC is asserted every time 
header information is analyzed in each processing sec- 
tion and prescribed conditions are established. 

Due to the series of initialization or reset opera- is 
tions. decoding of block data of the segments can be 
reliably started in response to assertion of the MB syn- 
chronizing signal MBSYNC to implement high speed 
arithmetic processing also in a reset operation Including 
an error return operation. 20 

In the aforementioned embodiment, decoding 
processing of picture data (pixel data) decoded along 
the MPEG standard Is described as an example of pixel 
data decoding processing. However, the present inven- 
tion is applicable also where processing is made in units 25 
of data blocks having certain sizes of variable length 
codes In place of the MPEG standard pixel data, if 
header Information is provided In a form of variable 
length codes for the block data. Further, the present 
invention is also applicable to data subjected to orthog- 30 
onal transformation other than DCT processing. 

Principal features of the present invention are as 
follows: 

(1) Header information is analyzed following 3S 
processing of a data block in one processing sec- 
tion, and data processing starting is done after all 
analysis of the header information is completed. 
One processing section is started in decoding of 

the data block and ended in analysis of the header 40 
information. When starting of the data processing is 
designated, therefore, each operational processor 
can immediately execute its processing, whereby 
utilization efficiency of the operational processors is 
improved and the data processing can be executed 45 
at a high speed. Further, the standby time of the 
operational processor is reduced, whereby the time 
period of one processing section can be reduced. 

(2) The time period of the processing section is 
changed in accordance with the result of analysis of so 
the header information. The time period of the 
processing section can be changed depending on 

the attributes of the segment to be processed and 
the optimum length of the processing section can 
be set in accordance with the attributes of the seg- ss 
ment to be processed. It Is possible to prevent such 
a malfunction that a next processing section is 
started before completion of one processing sec- 
tion, which may be caused in the case of a process- 



ing section of a fixed length time, and picture data 
can be efficiently and correctly processed. 

(3) Access to an external memory Is executed in 
parallel with decoding of data block data. An influ- 
ence exerted on pixel data decoding processing by 
the access to the extemal memory can be elimi- 
nated, and the processing time can be reduced. 
Further, necessary data can be efficiently supplied 
to a data processing part with no destruction of data 
required for pipeline processing in data processing 
part by carrying out the access to the external 
memory successively in order of writing of restored 
data, writing of an incoming bit stream, reading of 
display picture data, reading of predictive picture 
data and reading of the bit stream. 

(4) When an error occurs in a header information 
analyzing process or a variable length decoding 
process, a start code having a prescribed pattern is 
detected and header Information of a segment fol- 
lowing the start code is analyzed so that processing 
of a data block subsequent to the analyzed header 
information is delayed until prescribed conditions 
are satisfied after completion of the analysis. 
Processing can be started at a segment having no 
Influence by an error in starting of processing in 
error generation, while the processing is started 
from decoding of the data block also in tills 
processing starting upon error generation, whereby 
reduction of utilization of each operational proces- 
sor included in data processing part can be sup- 
pressed also after recovery from the error, and data 
processing can be executed at a high speed. 

(5) A pipeline is formed having one processing unit 
of a processing section correspond to a segment. 
Reduction of utilization efficiency of a computing 
element of each pipeline can be suppressed to the 
minimum and high-speed data processing is ena- 
bled. Further, one processing unit (segment) can 
be shared by a plurality of processing sections in a 
pipeline manner due to pipeline stages, whereby 
tiie time period for the processing section can be 
reduced and high-speed data processing is ena- 
bled. 

(6) The pipeline stages are formed into a four-stage 
pipeline structure in units of segments in accord- 
ance with the content of the processing. It is possi- 
ble to execute a pipeline operation with the 
minimum wait time of each operational processor 
even If the time period of the processing section 
varies, whereby high-speed data processing can be 
carried out. Due to the pipeline structure, further, 
header information can be analyzed In parallel with 
data processing, whereby the time period for the 
processing section can be reduced and high-speed 
data processing is implemented. 

(7) In error processing, block data of a segment 
precedent to that having an error detected are 
repaired in the pipeline stage, with delay of the 
pipeline stage efficiently utilized, an error repair 
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operation can be made on the segment having the 
error caused, and deterioration in quality of a 
decoded picture caused by mixing of an error bit 
can be suppressed. 

(8) When a reset request is made, a start code hav- s 
ing a prescribed pattern is searched and a process- 
ing start indication signal is asserted when 
prescribed conditions are established after header 
information of a segment following the start code is 
entirely analyzed, to execute processing of the data w 2. 
block of this segment Processing can be reliably 
executed from the starting of a picture also in reset- 
ting while each operational processor can be imme- 
diately driven in response to the processing starting 

to carry out data processing, whereby high speed is 
processing can be carried out. 

(9) Data decoding processing is started in synchro- 
nization with an externally supplied picture synchro- 
nizing signal (vertical synchronizing signal) 
indicating starting of a picture. Also in resetting, a 20 3. 
correct pixel data processing operation and reading 

of display picture data can be carried out by estab- 
lishing synchronization with the synchronizing sig- 
nal supplied from an external control unit. 

25 4. 

Although the present invention has been described 
and illustrated in detail, it is clearly understood that the 
same is by way of illustration and example only and is 
not to be taken by way of limitation, the spirit and scope 
of the present invention being limited only by the terms 30 
of the appended claims. 

Claims 

1. A picture decoding circuit for expanding a moving 3S 
picture compressed in accordance with a predeter- 
mined procedure in units of segments of prescribed 5. 
sizes, each said segment having a data block 
including data to be processed and a header having 
information indicating an attribute of said data of 40 
said data block, said picture decoding circuit com- 
prising: 

header decoding means (3, 6) receiving a bit 
stream including said segments and irxJicating 4S 
said moving picture information for extracting 
and analyzing said information of said header 
of a segment and forming information indicat- 
ing a processing to be subsequently executed; 
control means (1226) generating a data so 
processing start indication signal (MBSYNC) in 
response to a completion signal (<t>CPL) from 
said header decoding means indicating com- 
pletion of said analysis of said information of 
said header of said segment; and ss 
data processing means (4. 1214. 1216. 1218. 6. 
1220) coupled to receive said bit stream and 
activated in response to said data processing 
start indication signal for executing processing 



of a data block following said header of said 
segment in accordance with the result of said 
analysis by said header decoding means, 
said header decoding means analyzing infor- 
mation of a header supplied in continuation to 
each said segment, continuously to processing 
of a precedent segment to generate said com- 
pletion signal. 

The picture decoding circuit according to claim 1, 
wherein said control means (1226) includes drive 
means (1 1 , 1 2, 1 6) coupled to receive said comple- 
tion signal and responsive to assertion of said com- 
pletion signal for determining whether a 
predetermined condition Is met and asserting said 
data processing start indication signal (MBSYNC) 
when said predetermined condition Is met in 
accordance with the result of determination. 

The picture decoding circuit according to claim 1 or 
2, wherein said data processing start indication sig- 
nal (MBSYNC) determines a period for processing 
a segment. 

The picture decoding circuit according to one of 
claims 1 to 3, further comprising an external mem- 
ory (1230) for storing data of said bit stream, data 
processed by and supplied form said data process- 
ing means (4, 1212. 1214. 1216). and wherein said 
control means (1226) comprises drive means (11, 
12, 1 6) for identifying that no access is made to said 
external memory and that a preset time is elapsed 
since a precedent assertion of said data processing 
start indication signal when said completion signal 
being asserted is applied. 

The picture decoding circuit according to one of 
claims 1 to 4. wherein said control means (1226) 
includes 

timer (16) activated in response to said data 
processing start indicating signal being 
asserted for counting a time up to a preset 
time, 

operation driver (11) coupled to receive the 
completion signal from said header decoding 
means (3, 6) for asserting said data process 
start indicating signal (MBSYNC) in response 
to assertion of said completion signal, condi- 
tioned that at least said timer generates a time 
up signal indicating that the count of time 
attains said preset time, 
wherein said timer (16) preferably has a preset 
time variable. 

The picture decoding circuit according to claim 5, 
wherein said control means (1226) includes means 
(11) coupled to receive the information of the 
header from said header decoding means (3, 6), for 
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changing said preset time in accordance with the 
received information of the header 

7. The picture decoding circuit in accordance with one 

of claims 1 to 6. wherein said compressed moving s 
picture includes pixel data subjected to a prediction 
encoding, and said data processing means (4, 
1212. 1216, 1218) includes means (1212, 1216. 
1218. 1220) carrying out expansion processing 
inverse to said prediction encoding on said data of io 
said data block for restoring original pixel data, 

said control means (1226) including access 
means (12) for sequentially executing storage 
of said restored pixel data from said data is 
processing means in an externally provided 
memory device (1230). writing of data of said 
bit stream into the memory device, reading of 
data to be displayed among said restored pixel 
data from said memory device, and reading of 20 
predictive picture pixel data required for resto- 
ration of pixel data into said data processing 
means in a prescribed order in said unit 
processing section in response to said data 
processing start indication signal being 2S 
asserted, wherein said access means (12) 
preferably executes said storage, said wrKing 
and said reading within a period between suc- 
cessive assertion of said data process start 
indicating signal (MBSYNC). 30 

8. The picture decocGng circuit according to claim 7. 
wherein said access means (12) executes, in 
response to assertion of said data process start 
indicating signal, storage of the restored pixel data 3s 
into the memory device (1230). the writing of data 

of the bit stream into said memory device, reading 
of data to be displayed from said memory device, 
the reading data of the predictive pixel data from 
said memory device into said data processing 4o 
means (1212. 1214. 1216). and reading of data of 
the bit stream from said memory device into said 
data processing means successively in this 
described order. 

45 

9. The picture decoding circuit according to one of 
claims 1 to 8, wherein said data processing means 
(4. 1212. 1214. 1216. 1218. 1220) includes a varia- 
ble length decoder (1212) for variable length decod- 
ing data of said data block to generate fixed length so 
data, an inverse quantizer (1214) coupled to 
receive said fixed length data for inverse-quantizing 
the received fixed length data, a scan converter 
(1216) coupled to said inverse quantizer for con- 
verting a scan order of the received inverse-quan- ss 
tized fixed length data into a raster scan order, an 
inverse orthogonal transformer (1218) coupled to 
said scan converter for performing a predetermined 
orthogonal transformation on data received from 



said scan converter, and a pixel reconfigurator 
(1220) coupled to said inverse orthogonal trans- 
former for performing a predetermined operation on 
data received from said inverse orthogonal trans- 
former to restore original pixel data, wherein said 
variable length decoder, said inverse quantizer, 
said scan converter, said inverse orthogonal trans- 
former and said pixel reconfigurator are activated to 
start respective processings in response to asser- 
tion of said data processing start indicating signal 
(MBSYNC). 

10. The picture decoding circuit according to claim 9, 
wherein said header decoding means (3, 6) 
includes analyzing means (3) performing the ana- 
lyzing of the information of the header of a subse- 
quent segment in parallel with processing operation 
of a current segment in at least said inverse quan- 
tizer (1214). after completion of processing of the 
data block of said current segment in said variable 
length decoder (1212). 

1 1. The picture decoding circuit according to claim 9 or 
10, further comprising an error detector (5, 6) cou- 
pled to said header decoding means (3. 6) and said 
data processing means (4) for detecting an error 
generated in said header decoding means and said 
data processing means to assert an error detect 
signal (4>ER), and wherein said control means 
(1216) incudes an error process means (13, 15) 
coupled to receive said error detect signal for 
asserting an error processing signal (<>ERR), and 
wherein 

said scan converter (1216) incudes error con- 
ceal means (42, 43. 44. 45) for storing error 
concealment data and for supplying the error 
concealment data to said inverse orthogonal 
transformer in response to the assertion of said 
error processing signal. 

12. The picture decoding circuit according to one of 
claims 9 to 11 , wherein said scan converter (1216) 
includes. 

decoder means (40, 41) coupled to receive 
data from the inverse quantizer for reordering a 
sequence of data into the raster scan order on 
a unit of the segment. 

average/storage means (44. 43) coupled to 
receive data from said said reorder means for 
obtaining an average value of received data on 
a unit of segment for storage, 
selection means (44, 45) coupled to receive 
data of said reorder means and said aver- 
age/storage means for selecting and passing 
data received from said average/storage 
means in response to assertion of said error 
processing signal onto said inverse orthogonal 
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transformer, wherein said average/storage 
means (44, 43) preferably includes storage 
means (43) for storing average data of the seg- 
ments worthy amount of one line of the screen 
in a f irst-in first out fashion and/or s 
wherein said pixel reconfigurator (1220) prefer- 
ably includes a selection means (33. 35) in 
response to assertion of said error processing 
signal ((|>ERR) for selecting and passing data 
received from said inverse orthogonal trans- w 
former (1218) as said restored pixel data. 

13. The picture decoding circuit according to claim 11 
or 12. further comprising. 

15 

Start code detection means (2, 6) coupled to 
receive said bit stream and to said error detec- 
tor (5, 6), for detecting a start code of a prede- 
termined pattern in the received bit stream to 
generate a start code detection signal {<^SD) in 20 
response to the assertion of said error detect 
signal (((>ER), and wherein said control means 
(1226) includes means (11, 13, 15) responsive 
to the assertion of said start code detection sig- 
nal lor deasserting said error processing signal 2s 
(<|)ERR) when a predetermined condition is 
met. 

14. The picture decoding circuit according to one of 
claims 11 to 13, wherein said bit stream includes 30 
said start code followed by the header information 
including an address indicating a segment at which 
return from the error is made, and wherein 

said control means (1 226) includes means (11. 35 
13, 15) receiving said address and said com- 
pletion signal from said header decoding 
means (3, 6) and the start code detecting sig- 
nal, for detemriining that said predetermined 
condition is met when said address indicates a 40 
segment to be processed in response to a next 
assertion of the process start indicating signal 
(MBSYNC) and said completion signal and 
said start code detecting signal are asserted, 
wherein said predetermined condition prefera- 4S 
bly further includes that a predetermined time 
is elapsed since a precedent assertion of the 
process start indicating signal (MBSYNC). no 
access is made to an external memory (1230) 
storing bit stream data and restored pixel data, so 
and tiie bit stream data is supplied from the 
external memory to the data processing means 
(4). 

15. The picture decoding circuit according to one of 55 
claims 1 to 12. further comprising 

start code detector (2. 6) coupled to receive the 
bit stream for detecting a start code of a prede- 



tennined pattern, said start code being fol- 
lowed by the header information in the bit 
stream, and wherein said control means (1226) 
further comprises, 

initialization means (11, 14) responsive to a 
reset request signal ((j^RRQ) for maintaining 
said data processing start indicating signal 
(MBSYNC) deasserted and for asserting a 
start signal onto said start code detector to 
cause said start code detector to search for the 
start code, said start signal also applied to said 
header decoding means (3, 6) to cause the 
header decoding means to analyze information 
of a header following the start code, 
drive means (11.15) responsive to a start code 
detecting signal being asserted from said start 
code detector and the completion signal from 
the header decoding means, for asserting said 
data processing start indication signal, 
wherein said drive means (11, 15) preferably 
Includes means (15) for delaying the assertion 
of said start signal until said data processing 
means (4. 1212, 1216, 1218, 1220) completes 
the processing on data of a segment applied 
when said reset signal is asserted. 

16. The picture decoding circuit according to claim 15, 
further comprising an extemal memory (1230) for 
storing data of the bit stream and pixel data 
restored by said data processing means (4. 1212, 
1216. 1218, 1220). and wherein said control means 
(1226) further comprises 

bus controller (12) coupled to said external 
memory, for monitoring an access to said exter- 
nal memory and transfer of data between said 
external memory and said data processing 
means, 

timer (16) coupled to said drive means (11,15) 
and responsive to assertion of said data 
processing start indication signal for counting a 
time up to a preset time to generate a time-up 
signal when the count reaches the preset time, 
and 

said drive means (1 1 . 15) includes means (1 1) 
coupled to said bus controller and said timer 
and to receive a picture synchronization signal 
providing a timing of displaying a picture on a 
display screen, and responsive to said bus con- 
troller Indicating that data of bit stream is trans- 
ferred from said external memory to said data 
processing means and that no access is made 
to said external memory and to said time-up 
signal being asserted and to said picture syn- 
chronization signal being asserted for causing 
said data processing start indicating signal to 
be asserted when said start code detecting sig- 
nal and said completion signal both are 
asserted. 
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wherein sard drive means (11. 15) further 
responds to said bus controller (12) Indicating 
that at least a predetermined amount of data of 
the bit stream is stored in said external memory 
and that at least another predetermined 5 
amount of data of bit stream is transferred from 
said external menrKsry to said data processing 
means. 

17. A picture decoding circuit for expanding a moving 10 
picture compressed in accordance with a predeter- 
mined procedure In units of segments of prescribed 
sizes for restoring decompressed picture data, said 
compressed moving picture being variable length 
encoded, each said segment having a data block is 
including data to be processed and a header having 
information indicating attributes of said data of said 
data blocK said picture decoding circuit including: 

data processing means (4. 1212, 1216. 1218, 20 
1220) comprising (i) analysis means (3, 6) for 
detecting a header from a supplied bit stream 
and analyzing information of said header 
including means (6) generating (<t)CPL) a signal 
indicating completion of analysis of all said 25 
header information, (ii) variable length decod- 
ing means (4. 1212. 1214, 1216. 1220) for var- 
iable length decoding pixel data of a data block 
of said segment in accordance with the result 
of said analysis of said analysis means and so 
forming fixed length pixel data and restoring 
said pixel data of said data block to decom- 
pressed pixel data; 

detect means (5, 6) coupled to said analysis 
means and said variable length decoding 3S 
means for generating an error detection signal 
indicating an error when said error is detected 
in processing of said analysis means and said 
variable length decoding means; 
code search means (2, 6) coupled to said 40 
detect means for searching for a code having a 
predetermined pattern from incoming said bit 
stream in response to said error detection sig- 
nal; 

activation means (1226. 6) coupled to said 45 
code search means for activating said analysis 
means in response to code detection by said 
code search means; and 
means (1226, 6) delaying execution of 
processing of a data block following a header so 
following the code by said data processing 
means till establishment of a prescribed condi- 
tion in response to an analysis completion indi- 
cation signal indicating conpletion of analysis 
of said information of said header from said ss 
analysis means. 

18- The picture decoding circuit in accordance with one 
of claims 1 to 17. wherein said data processing 
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means (4. 1212. 1216, 1218, 1220) includes a plu- 
rality of pipeline stages performing processing in a 
pipeline manner with said segments as processing 
units, wherein one pipeline stage is responsible for 
each said segment, 

wherein said pipeline stages preferably include: 

a first pipeline stage for carrying out loading of 
predictive picture data from a memory device 
(1230). variable length decoding of an orthogo- 
nal transformation coefficient of said data block 
followed by inverse quantization thereof, 
a second pipeline stage for forming a predictive 
picture from said loaded predictive picture pixel 
data. 

a third pipeline stage for carrying out inverse 
orthogonal transformation processing of the 
inverse quantized pixel data and restoration of 
said pixel data of said data block from said pre- 
dictive picture pixel data and said inverse 
orthogonal transformation processed pixel 
data, and 

a fourth pipeline stage for writing said restored 
pixel data in said memory device and/or means 
(1226, 1216, 1220) responsive to an error 
detection signal for carrying out prescribed 
error repair processing in said pipeline stages 
from a data block of a segment being posi- 
tioned in front of a segment at which said error 
is detected in a processing order in said data 
V processing means (4, 1212, 1216, 1214, 1218, 
1220). 

19. A picture decoding circuit for extending a moving 
picture compressed in accordance with a predeter- 
mined procedure in units of segments of prescribed 
sizes for restoring decompressed picture pixel data, 
said compressed moving picture being variable 
length encoded, each said segment having a data 
block including pixel data following a header indicat- 
ing attributes of said data block, said picture decod- 
ing circuit including: 

analysis means (3, 6) coupled to receive a bit 
stream for analyzing information included in a 
header of a segment included in the supplied 
bit stream; 

data processing means (4, 1212, 1214, 1216, 
1218. 1220) including variable length decoding 
means (4) for performing variable length 
decoding processing on data of a data block 
following the header in accordance with the 
result of said analysis of said analysis means, 
for restoring said data of said data block to orig- 
inal picture data; 

search means (2, 6) for searching for a code 
having a prescribed pattern in the supplied said 
bit stream in response to said start signal; 
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means (6, 11. 14) generating a start signal for 
starting said search means in response to a 
reset request signal; 

means (6. 11, 14) for activating said analysis 
means in response to detection of said code by s 
said search means; and 
means (11. 12. 15, 16) delaying execution of 
processing of a data block following a header 
following said code by said data processing 
means till establishment of a prescribed condi- io 
tion in response to an analysis completion indi- 
cation signal indicating completion of analysis 
of said information of said header from said 
analysis means. 

IS 

20. The picture decoding circuit in accordance with 
claim 19, wherein said prescribed condition is appli- 
cation of a synchronizing signal (PSYNC) indicating 
a start point of a picture to be displayed. 

20 
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